Doormat CrawlerCheck
AI crawler access checker over MCP, free. Tool check_ai_crawler_access reports which named AI bots (GPTBot, ClaudeBot, etc.) your robots.txt allows or blocks. Paid /report (0.03 USDC, x402 on Base) adds a plain-English recommendation and ready-to-paste robots.txt snippet.
Documentation
crawlercheck
Checks which of the ~20 named AI crawlers (GPTBot, ClaudeBot, PerplexityBot, CCBot, Google-Extended and more) your site's robots.txt currently allows or blocks.
Free, no signup. Paid (0.03 USDC on Base): /report?url= adds a plain-English recommendation and a ready-to-paste robots.txt snippet.
crawlercheck by Doormat Capital — free AI-crawler robots.txt checker. Submitted to Twelve Tools.
Our fortnightly notes on what we ship: doormat.sebastiaan-ba3.workers.dev