• Latest Nutch-based Bot user agents:
  • User agent
    TestCrawler/Nutch-1.21-SNAPSHOT
    Nutch Crawler/Nutch-1.18
    Nutch/Nutch-1.15
    JSACrawlerBot/Nutch-1.20
    MyNutchCrawler/Nutch-1.20
    presearch_com Spider/Nutch-1.20
    MyBot/Nutch-1.15-SNAPSHOT
    OI-Crawler/Nutch (https://openintel.nl/webcrawl/)
    Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20100101 Firefox/10.0/Nutch-1.9
    TestCrawler/Nutch (https://about:blank/)
    AliyunSecBot/Nutch-1.21-SNAPSHOT
    tbot-nutch/Nutch-1.10
    Tetun Crawler Nutch Spider/Nutch-1.19
    SonyEricssonK750i/R1N Browser/SEMC-Browser/4.2 Profile/MIDP-2.0 Configuration/CLDC-1.1/Nutch-1.0-dev
    Nutch/2.2.1 (page scorer; http://integralads.com/site-indexing-policy/)
    Neo Lee/Nutch-0.9 (Nutch spiderman; http://lucene.apache.org/nutch/; MyEmail)
    MXT/Nutch-1.10
    Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.2214.115 Safari/537.36/Nutch-2.3
    Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.101 Safari/537.36 QIHU 360SE/Nutch-1.13
    Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.82 Safari/537.36/Nutch-1.18