• Latest Heritrix user agents:
  • User agent
    Mozilla/5.0 (Linux; Android 14.0; Samsung Galaxy S24; ZumBot/1.0; http://help.zum.com/inquiry) AppleWebKit/537.36 (KHTML, like Gecko) Heritrix/2.0 Chrome/123.0.0000.0 Mobile Safari/537.36 (Java/5.0; www.java.com)
    Mozilla/5.0 (Linux; Android 14.0; Samsung Galaxy S24) AppleWebKit/537.36 (KHTML, like Gecko) Heritrix/2.0 Chrome/123.0.0000.0 Mobile Safari/537.36
    heritrix
    Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20160721-2308 +https://www.domaincodex.com)
    mozilla/5.0 (compatible; heritrix/1.3.0 http://archive.crawler.org)
    flieder - neofonie heritrix/1.14.3 ( http://spider.neofonie.de)
    Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20150302-2206 +http://127.0.0.1)
    Mozilla/5.0 (compatible; heritrix/3.4.0 +https://www.kb.dk/netarkivindsamling/) Firefox/57
    Arquivo-web-crawler (compatible; heritrix/3.4.0-20200304 +https://arquivo.pt/faq-crawling)
    Mozilla/5.0 (compatible; heritrix/3.4.0 +https://www.kb.dk/netarkivindsamling/)
    Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20160309-0050; UniLeipzigASV +http://corpora.informatik.uni-leipzig.de/crawler_faq.html)
    Mozilla/5.0 (compatible; heritrix/3.4.0-20200518 +https://josephtparsons.com)
    Mozilla/5.0 (compatible; kb.dk_bot; heritrix/3.4.0 +https://www.kb.dk/netarkivindsamling/) Firefox/57
    Mozilla/5.0 (compatible; heritrix/3.4.0-SNAPSHOT-2019-05-22T20:43:22Z +http://www.nationallibrary.fi)
    Mozilla/5.0 (compatible; heritrix/2.0.2 +http://localhost)
    Mozilla/5.0 (compatible; heritrix/3.4.0-20200304 +http://hbi640.ir/)
    arquivo-web-crawler (compatible; heritrix/3.4.0-20200304 +http://arquivo.pt)
    Mozilla/5.0 (compatible; heritrix/3.3.0-LBS-2016-02 +https://www.kb.nl/contact)
    arquivo-web-crawler (compatible; heritrix/3.4.0-20190418 +http://arquivo.pt)
    Mozilla/5.0 (compatible; heritrix/3.3.0 +https://www.kb.se/hitta-och-bestall/hitta-i-samlingarna/kulturarw3.html)