AI2Bot

Academic research crawler (Allen AI); builds open datasets (Dolma)

Should you block it?

Your call — blocking is a legitimate choice

AI2Bot is Allen Institute for AI's training/data crawler. Blocking it opts your content out of Allen Institute for AI's model training and datasets. It does not remove you from AI answers — citations are governed by separate retrieval crawlers.

Common reasons to block: copyright or licensing policy, competitive sensitivity, paywalled content.
Common reasons to allow: maximum AI reach, research visibility, and being part of the datasets future models learn from.

How to allow it in robots.txt

User-agent: AI2Bot
Allow: /

How to block it

User-agent: AI2Bot
Disallow: /

Check your site now

See whether AI2Bot — and 39 other AI crawlers — can reach your site today.

Run a free check →

checkaibots.com — AI visibility checker · Free · No signup