ClaudeBot is Anthropic's web crawler used to gather content for Claude training and live retrieval. Like GPTBot, blocking ClaudeBot removes the site from Claude's knowledge and citations. For AEO purposes, ClaudeBot should be allowed.
Crawls the open web to gather training data for Claude and retrieve content in real time during browse-enabled Claude sessions. The mechanics mirror GPTBot.
Yes, in nearly all cases. Anthropic published ClaudeBot specifically to give site owners control over Claude crawling. Allowing it keeps your brand discoverable and citable inside Claude responses.
Audit your robots.txt for ClaudeBot-specific rules. Use the AI Agent Readiness Check which tests crawler access for all major AI bots.
Run the free 50-signal AI Agent Readiness Check or book a free scoping call.
Score my site