| Mozilla/5.0 (compatible; AdBot/1.0) |
| DigitalOcean Uptime Probe 0.22.0 (https://digitalocean.com) |
| Opera/9.80 NETTV/4.5.0 Mozilla/5.0 (Linux armv7i; CE-HTML/1.0; U; en) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.75 Safari/537.36 Tbrowser/2.0 _TV_NT563/V8-NT563AM-LF1V076 (Vortex,32D2070,wireless) |
| Facebot |
| CheckMarkNetwork/1.0 ( http://www.checkmarknetwork.com/spider.html) |
| friendly-spider |
| test-bot |
| Mozilla/5.0 (Linux; Android 13; M2102J20SG; AGAKIDSBOT/3.1+agakids.ru/project) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/112.0.0.0 Mobile Safari/537.36 |
| MJBot/0.1 |
| SirdataBot (+https://semantic-api.docs.sirdata.net/contextual-api/contextual-api/introduction) |
| yandex-bot |
| Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 crawler-rules |
| peer39_crawler/1.0 |
| YouBot (+http://www.you.com) |
| super_deadly_malware_bot_3_0_0 |
| BadBot/1.0.2 (+http://bad.bot) |
| IAS Crawler (ias_crawler; http://integralads.com/site-indexing-policy/) |
| Clickagy Intelligence Bot v2 |
| labjs.pro/bot |
| daumoa,damoa,daum,daumos,duamoa,duam,duamos |