meta-webindexer

Meta AI search index; blocking removes you from Meta AI answers

Should you block it?

Almost never block

meta-webindexer builds and refreshes the index behind Meta's AI answers. Blocking it is the most expensive mistake in AI SEO: you disappear from Meta citations while your training decision stays completely separate.

If you need to protect specific sections (pricing, docs), use path-scoped rules instead of a blanket Disallow: /.

How to allow it in robots.txt

User-agent: meta-webindexer
Allow: /

How to block it

User-agent: meta-webindexer
Disallow: /

Check your site now

See whether meta-webindexer — and 39 other AI crawlers — can reach your site today.

Run a free check →

Other Meta crawlers

checkaibots.com — AI visibility checker · Free · No signup