Claude answer retrieval; blocking stops Claude from citing you
Almost never block
Claude-SearchBot builds and refreshes the index behind Anthropic's AI answers. Blocking it is the most expensive mistake in AI SEO: you disappear from Anthropic citations while your training decision stays completely separate.
If you need to protect specific sections (pricing, docs), use path-scoped rules instead of a blanket Disallow: /.
User-agent: Claude-SearchBot Allow: /
User-agent: Claude-SearchBot Disallow: /
See whether Claude-SearchBot — and 39 other AI crawlers — can reach your site today.