I's not because a bot's location = a specific forum/topic/post that the bot can actually see the content. the whoisonline shows the location the bot is trying to access (the url), but if permissions don't allow it, the bot will see something like "you are not authorised to see this page".
In spite of that when I look at Who is online, I regularly see the Google [Bot] in the list and it says it is reading a topic in one of the forums. I know from ACP > General > Spiders/Bots that Bing [Bot] also visits.
I don't want ANY bot to have access to any part of my board and be able to index any pages on it.
You can test this using the bot's permission.
Similarly a guest can try to access a specific url but if permissions don't allow it, it may seem that the guest is viewing that page but in reality he'll see something similar to: you are not authorised to see this)
It's impossible to stop anyone from trying to access a specific url.
Statistics: Posted by warmweer — Mon Dec 16, 2024 8:01 pm