Google's main search crawler; almost never block
Almost never block
Googlebot builds and refreshes the index behind Google's AI answers. Blocking it is the most expensive mistake in AI SEO: you disappear from Google citations while your training decision stays completely separate.
If you need to protect specific sections (pricing, docs), use path-scoped rules instead of a blanket Disallow: /.
User-agent: Googlebot Allow: /
User-agent: Googlebot Disallow: /
See whether Googlebot — and 39 other AI crawlers — can reach your site today.