AI Crawler Check · Anchor Data Labs

Does your site
permit AI crawlers?

This checks, instantly, what your robots.txt permits for the main AI crawlers (ChatGPT, Claude, Gemini, Perplexity), and whether you publish an llms.txt and a sitemap. It shows what you allow crawlers to read, not whether an AI already knows, retrieves, or recommends your business. Free.

• Ten AI crawlers. ChatGPT, Claude, Gemini, Perplexity, Apple Intelligence, Meta AI, and more.
• Instant. Reads robots.txt and checks for llms.txt and a sitemap. No crawl, no login.
• The first step. Access is table stakes; whether AI can actually use your content is the AI-Readiness Score.