ds-robot/Nutch-1.20-SNAPSHOT |
Tetun Crawler Nutch Spider/Nutch-1.19 |
your sipder name/Nutch-1.7 |
Your Nutch Spider/Nutch-2.2.1 |
testnutch/Nutch-1.8 |
Spider/Nutch-2.3-SNAPSHOT (Webcrawler) |
spider/Nutch-1.5.1 (spider; http://www.xxx.com) |
NutchSpider/Nutch-1.4 |
Nutch12/Nutch-1.2 |
MySpider/Nutch-2.2 |
My Nutch Spider/Nutch-1.6 |
Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.9.2.8) Firefox/3.6.8/Nutch-1.7 |
Mozilla/5.0 (compatible; summers;)/Nutch-1.7 |
CB/Nutch-1.7 |
5acd734a-1ed3-4a17-ad9d-0b09ae7bc2d2/Nutch-1.7 |
MXT/Nutch-1.10 |
Nutch/2.2.1 (page scorer; http://integralads.com/site-indexing-policy/) |
tbot-nutch/Nutch-1.10 |
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.2214.115 Safari/537.36/Nutch-2.3 |
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.82 Safari/537.36/Nutch-1.18 |