Anthropic's search crawler; disabling it may reduce your visibility and accuracy in Claude search results.
Almost never block
Claude-SearchBot builds and refreshes the index behind Anthropic's AI answers. Blocking it is the most expensive mistake in AI SEO: you disappear from Anthropic citations while your training decision stays completely separate.
If you need to protect specific sections (pricing, docs), use path-scoped rules instead of a blanket Disallow: /.
User-agent: Claude-SearchBot Allow: /
User-agent: Claude-SearchBot Disallow: /
Official source Operator documentation — last verified against operator docs 2026-09-12
"Should you block it?" below is our own interpretation, not the operator's recommendation.
See whether Claude-SearchBot — and 39 other AI crawlers — can reach your site today.