• Latest bots user agents:
  • User agent Name
    SiteSucker for macOS/5.1.11 SiteSucker
    ArchiveTeam ArchiveBot/20191207.38f77ff (wpull 2.0.3) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36 ArchiveBot
    Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; http://www.cloudflare.com/always-online) CloudFlare Always Online
    ArchiveTeam ArchiveBot/20190825.7691ba8 (wpull 2.0.3) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36 ArchiveBot
    newspaper/0.2.6 Scraping Robot
    MetaInspector/5.6.0 ( https://github.com/jaimeiniesta/metainspector) MetaInspector
    ArchiveTeam ArchiveBot/20190617.01 (wpull 2.0.3) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36 ArchiveBot
    Mozilla/5.0 (X11; U; Linux Core i7-4980HQ; de; rv:32.0; compatible; JobboerseBot; https://www.jobboerse.com/bot.htm) Gecko/20100401 Firefox/24.0 JobboerseBot
    Mozilla/5.0 (compatible; Google-Apps-Script) Google Apps Script
    FreeWebMonitoring SiteChecker/0.1 ( http://www.freewebmonitoring.com) FreeWebMonitoring