| Scrapy/2.13.2 (+https://scrapy.org) |
Scrapy |
| Screaming Frog SEO Spider/22.2 |
Screaming Frog SEO Spider |
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36 [SuperhumanProxy]/1.0 (email hello AT superhuman.com) |
Generic Bot |
| Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/a22694d warc/v0.8.82 |
archive.org bot |
| ForwardQR/1.0 ( https://forwardqr.com/bot.html) |
Generic Bot |
| Jigsaw_HD/3.8.1.14 CFNetwork/1335.0.3.4 Darwin/21.6.0 |
W3C CSS Validator |
| Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/4231a33 warc/v0.8.82 |
archive.org bot |
| LinkPreviewBot |
LinkPreview |
| Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; pageburst) Chrome/137.0.7151.119 Safari/537.36 |
Pageburst |
| Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36 Chrome-Lighthouse |
Lighthouse |