Skip to main content

Generic Bot specifications

Generic Bot is an automated web crawler and indexing bot (Crawler / Bot).

Operator Generic Bot Operators
Category Crawler / Bot

Latest Generic Bot user agents:

User Agent PlatformDevice
Mozilla/5.0 (compatible; RepetivBot/1.0; +mailto:podpora@repetiv.cz) UnknownUnknown
Mozilla/5.0 (compatible; ExaSearchBot/1.0; +https://crawler.exa.ai/) UnknownUnknown
redirect-scanner/1.0 UnknownUnknown
PPTestUserAgent/2.0 UnknownUnknown
YisouSpider /5.0 (Linux; U; Android 8.1.0; en-US; Nexus 6P Build/OPM7.181205.001) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/151.0.0.0 UCBrowser/12.11.1.1197 Mobile Safari/537.36 UnknownUnknown
ZenLink-Bot/1.0 UnknownUnknown
Mozilla/5.0 (compatible; CompassBot/1.0) UnknownUnknown
Mozilla/5.0 (compatible; PisarBot/1.0) UnknownUnknown
LohiSoftBot/1.0 (+message@lohisoft.com) UnknownUnknown
taste-research-crawler/1.0 (+research corpus; contact hamidah@tastelabs.com) UnknownUnknown
Mozilla/5.0 (compatible; SemaltIndexer/1.0) UnknownUnknown
RaBu-crawler UnknownUnknown
"OpenAI File Downloader, XaiImageApiFetch/1.0" UnknownUnknown
Mozilla/5.0 (compatible; SectorBot/1.0; +https://serdartorun.dev/bot) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124 Safari/537.36 UnknownUnknown
Mozilla/5.0 (compatible; HubSpotHeadScanner/1.0; +https://commoncrawl.org/) UnknownUnknown
EMAIL-EU-Academic-Crawler/4.1 UnknownUnknown
Rokapi/0.7 (SEO crawler) UnknownUnknown
Mozilla/5.0 (compatible; getdomaindata/1.0; +https://getdomaindata.com/bot) UnknownUnknown
Mozilla/5.0 (compatible; DAO-CRM-research/1.0) UnknownUnknown
Mozilla/5.0 (compatible; osentix-crawler/1.0; +https://osentix.com/bot) UnknownUnknown
Want to see more? Sign up free Log in