• Latest Nutch-based Bot user agents:
  • User agent
    ds-robot/Nutch-1.20-SNAPSHOT
    Tetun Crawler Nutch Spider/Nutch-1.19
    your sipder name/Nutch-1.7
    Your Nutch Spider/Nutch-2.2.1
    testnutch/Nutch-1.8
    Spider/Nutch-2.3-SNAPSHOT (Webcrawler)
    spider/Nutch-1.5.1 (spider; http://www.xxx.com)
    NutchSpider/Nutch-1.4
    Nutch12/Nutch-1.2
    MySpider/Nutch-2.2
    My Nutch Spider/Nutch-1.6
    Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.9.2.8) Firefox/3.6.8/Nutch-1.7
    Mozilla/5.0 (compatible; summers;)/Nutch-1.7
    CB/Nutch-1.7
    5acd734a-1ed3-4a17-ad9d-0b09ae7bc2d2/Nutch-1.7
    MXT/Nutch-1.10
    Nutch/2.2.1 (page scorer; http://integralads.com/site-indexing-policy/)
    tbot-nutch/Nutch-1.10
    Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.2214.115 Safari/537.36/Nutch-2.3
    Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.82 Safari/537.36/Nutch-1.18