Skip to main content

Crawler

Latest Crawler versions:

Latest Crawler user agents:

User Agent PlatformDevice
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.0.0 Safari/537.36 ArchiveBox/0.7.4 (+https://github.com/ArchiveBox/ArchiveBox/) curl/curl 8.14.1 (x86_64-pc-linux-gnu) UnknownUnknown
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.0.0 Safari/537.36 ArchiveBox/0.7.4 (+https://github.com/ArchiveBox/ArchiveBox/) wget/GNU Wget 1.21.3 UnknownUnknown
Scrapy/2.19.0 (+https://scrapy.org) UnknownUnknown
Mozilla/5.0 (iPhone; CPU iPhone OS 26_2 like Mac OS X) AdbeatBot/1.0 AppleWebKit/605.1.15 (KHTML, like Gecko) Version/26.2 Mobile/JNFU3Z Safari/604.1 UnknownUnknown
Mozilla/5.0 (compatible; SiteAuditBot/1.0; passive visitor-level checks) UnknownUnknown
Mozilla/5.0 (Linux; Android 10; K) adbeat.com/policy AppleWebKit/537.36 (KHTML, like Gecko) Chrome/146.0.0.0 Mobile Safari/537.36 UnknownUnknown
amazon-kendra UnknownUnknown
github-camo (6769072e) UnknownUnknown
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/154.0.0.0 Safari/537.36 GTmetrix UnknownUnknown
FindFiles.net/1.0 (compatible; +https://findfiles.net/bot) UnknownUnknown