• Latest Nutch-based Bot user agents:
  • User agent
    AliyunSecBot/Nutch-1.21-SNAPSHOT
    tbot-nutch/Nutch-1.10
    Tetun Crawler Nutch Spider/Nutch-1.19
    SonyEricssonK750i/R1N Browser/SEMC-Browser/4.2 Profile/MIDP-2.0 Configuration/CLDC-1.1/Nutch-1.0-dev
    Nutch/2.2.1 (page scorer; http://integralads.com/site-indexing-policy/)
    Neo Lee/Nutch-0.9 (Nutch spiderman; http://lucene.apache.org/nutch/; MyEmail)
    MXT/Nutch-1.10
    Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.2214.115 Safari/537.36/Nutch-2.3
    Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.101 Safari/537.36 QIHU 360SE/Nutch-1.13
    Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.82 Safari/537.36/Nutch-1.18
    Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/14.0.3 Safari/605.1.15/Nutch-1.15
    MaxPointCrawler/Nutch-1.19 (valassis.crawler at valassis dot com)
    FriendlyCrawler/Nutch-1.20-SNAPSHOT
    gh-index-bot/Nutch-1.0 (GH Web Search.; lucene.apache.org; gh_email at someplace dot com)
    ds-robot/Nutch-1.20-SNAPSHOT
    My Nutch Spider/Nutch-1.7
    Crawlbot/Nutch-1.19-SNAPSHOT
    My Nutch Spider/Nutch-1.15
    My Nutch Spider/Nutch-1.18
    test search engine/Nutch-1.19-SNAPSHOT