User Agents > Nutch
Nutch
Rating: 0
Mike - 3 Apr 2007 5:40 AM
Mike - 3 Apr 2007 5:40 AMNutch is an open source search engine. It supports both the robots.txt exclusion standard as well as robots meta.
Reply
Rating: 0 Mike - 3 Apr 2007 5:48 AM
Mike - 3 Apr 2007 5:48 AMLately I am seeing Nutch requests from two IP addresses 75.126.142.100 and 72.232.228.58. Both of them uses same user agent string "Nutch Test/Something strange (Nutch Test; http://www.mistral.com)". Since mistral.com does not have any search, most likely they simply use Nutch for "legitimate" referrer spam.