Trains Claude models; restricting it signals your content should be excluded from Anthropic training datasets.
Your call — blocking is a legitimate choice
ClaudeBot is Anthropic's training/data crawler. Blocking it opts your content out of Anthropic's model training and datasets. For this crawler, training and citation are separate decisions — citations are governed by the operator's retrieval crawler.
Common reasons to block: copyright or licensing policy, competitive sensitivity, paywalled content.
Common reasons to allow: maximum AI reach, research visibility, and being part of the datasets future models learn from.
User-agent: ClaudeBot Allow: /
User-agent: ClaudeBot Disallow: /
Official source Operator documentation — last verified against operator docs 2026-09-12
"Should you block it?" below is our own interpretation, not the operator's recommendation.
See whether ClaudeBot — and 39 other AI crawlers — can reach your site today.