
06-25-2008, 06:40 PM
|
|
Premier Member
|
|
Join Date: Oct 2006
Location: Calgary, AB, Canada
Posts: 5,072
|
|
It's not a good idea to block a search bot, it would cause G35Driver to be dropped from Yahoo's search list.
Quote:
|
Originally Posted by Zachery from vBulletin Team
Well, no one will be finding your sites though yahoo if you don't let them spider, there is a crawl delay setting which will slow thme down slightly.
Its not good to ban any of the major SE's unless you just dont want any trafic from them ever.
|
Quote:
|
Originally Posted by Zachery from vBulletin Team
Not at this time, all guests are guests, and are users online, its not really a lie that you had 900+ something or others browsing your site.
|
Quote:
|
Originally Posted by Zachery from vBulletin Team
Spiders, are just computers, just like your computer. A spider is no differnt from a real user. Simple point is, that there were that many active computers visiting your site, regardless of the fact if they were being piloted by a real person, or some computer algorythm.
|
|