• Latest Nutch-based Bot user agents:
  • User agent Platforms Browser
    clark-crawler2/Nutch-1.19-SNAPSHOT
    SonyEricssonK750i/R1N Browser/SEMC-Browser/4.2 Profile/MIDP-2.0 Configuration/CLDC-1.1/Nutch-1.0-dev SEMC-Browser 4
    Mozilla/5.0 (compatible; Nutch/0.9; +http://lucene.apache.org/)/Nutch-0.9 (Nutch 0.9 experimental; http://www.mind-to-mind.com; gtn@mind-to-mind.com)
    Neo Lee/Nutch-0.9 (Nutch spiderman; http://lucene.apache.org/nutch/; MyEmail)
    test/Nutch-0.8.1 (test; www.apache.org; test@apache.org)
    Mozilla/5.0 (Windows; N; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727)/Nutch-1.1 (Crawler; lucene.apache.org/nutch/; a@b.net) Windows XP Internet Explorer 6
    Webcrawler/Nutch-1.0-dev (Test crawl; lucene.apache.org/nutch/; a@b.net)
    gh-index-bot/Nutch-1.0 (GH Web Search.; lucene.apache.org; gh_email at someplace dot com)
    Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.101 Safari/537.36 QIHU 360SE/Nutch-1.13 Windows 10 360 Browser
    MaxPointCrawler/Nutch-1.17 (valassis.crawler at valassis dot com)