Crawler OpenRobotsTXT specifications
OpenRobotsTXT is an automated web crawler and indexing bot (Crawler).
| Operator | Majestic-12 Limited |
|---|---|
| Category | Crawler |
Latest Crawler OpenRobotsTXT user agents:
| User Agent | Platform | Device |
|---|---|---|
| Mozilla/5.0 (compatible; ORT/v1.0.0; visit ORTc.me ) | Unknown | Unknown |