User Agents > SurveyBot
SurveyBot
Rating: 0
Mike - 3 Apr 2007 6:08 AM
Mike - 3 Apr 2007 6:08 AMSurveyBot is a probe for whois.sc. It does not crawl websites it just requests robots.txt and the homepage. It can be blocked by inserting the following text to the robots.txt file:
User-agent: SurveyBot
Disallow: /
User-agent: SurveyBot
Disallow: /
Reply
Rating: 0 Madeline Binder - 4 Sep 2008 8:29 PM
Madeline Binder - 4 Sep 2008 8:29 PMsorry, forgot to put my email: thegoodlife@comcast.net
where do you put the robots.txt file how do you code it?
where do you put the robots.txt file how do you code it?
Rating: 0 Madeline Binder - 4 Sep 2008 8:27 PM
Madeline Binder - 4 Sep 2008 8:27 PMhow do you code it and where do you put it?