Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20160721-2308 +https://www.domaincodex.com) |
mozilla/5.0 (compatible; heritrix/1.3.0 http://archive.crawler.org) |
flieder - neofonie heritrix/1.14.3 ( http://spider.neofonie.de) |
Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20150302-2206 +http://127.0.0.1) |
Mozilla/5.0 (compatible; heritrix/3.4.0 +https://www.kb.dk/netarkivindsamling/) Firefox/57 |
Arquivo-web-crawler (compatible; heritrix/3.4.0-20200304 +https://arquivo.pt/faq-crawling) |
Mozilla/5.0 (compatible; heritrix/3.4.0 +https://www.kb.dk/netarkivindsamling/) |
Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20160309-0050; UniLeipzigASV +http://corpora.informatik.uni-leipzig.de/crawler_faq.html) |
Mozilla/5.0 (compatible; heritrix/3.4.0-20200518 +https://josephtparsons.com) |
Mozilla/5.0 (compatible; kb.dk_bot; heritrix/3.4.0 +https://www.kb.dk/netarkivindsamling/) Firefox/57 |
Mozilla/5.0 (compatible; heritrix/3.4.0-SNAPSHOT-2019-05-22T20:43:22Z +http://www.nationallibrary.fi) |
Mozilla/5.0 (compatible; heritrix/2.0.2 +http://localhost) |
Mozilla/5.0 (compatible; heritrix/3.4.0-20200304 +http://hbi640.ir/) |
arquivo-web-crawler (compatible; heritrix/3.4.0-20200304 +http://arquivo.pt) |
Mozilla/5.0 (compatible; heritrix/3.3.0-LBS-2016-02 +https://www.kb.nl/contact) |
arquivo-web-crawler (compatible; heritrix/3.4.0-20190418 +http://arquivo.pt) |
Mozilla/5.0 (compatible; heritrix/3.3.0 +https://www.kb.se/hitta-och-bestall/hitta-i-samlingarna/kulturarw3.html) |
Mozilla/5.0 (compatible; heritrix/3.3.0 +http://www.bne.es/es/Colecciones/ArchivoWeb/AvisoWebmasters/index.html) |
Mozilla/5.0 (compatible; heritrix/1.14.4 +http://www.exif-search.com) |
Mozilla/5.0 (compatible; heritrix/3.3.0 +http://netarkivet.dk/webcrawler/) |