Free tool · No sign-up · Results in about 10 seconds
Check whether ChatGPT, Claude, Perplexity, Gemini, Microsoft Copilot and Google AI Overviews can actually crawl and read your site. You get a score, a fix for every issue, and a ready-to-paste robots.txt snippet.
Try:
What the check covers
Answer engine optimization (AEO) starts with access. If AI crawlers can't reach and read your pages, nothing else matters.
robots.txt rules for 9 crawlers behind ChatGPT, Claude, Perplexity, Gemini, Copilot, Google AI Overviews and Apple Intelligence.
Most AI crawlers don't run JavaScript. We measure how much of your homepage is in the raw HTML.
HTTP status and noindex directives that would keep answer engines away.
JSON-LD such as Organization that helps AI recognize your brand as an entity.
The basic signals AI uses to summarize what your company does.
Whether crawlers can discover all of your important pages.
An optional plain-text summary of your site written for AI tools.
Built by AGI Search Labs
We're an AEO and GEO agency working with mid-market and enterprise B2B teams. The free Agent Blindness Report goes well beyond this tool:
It reads your public robots.txt and reports whether the crawlers behind ChatGPT (GPTBot, OAI-SearchBot, ChatGPT-User), Claude (ClaudeBot), Perplexity (PerplexityBot), Gemini (Google-Extended), Google AI Overviews (Googlebot), Microsoft Copilot (Bingbot) and Apple Intelligence (Applebot-Extended) are allowed. It also checks whether your homepage is indexable, whether its text is readable without JavaScript, and whether you have JSON-LD structured data, a title and meta description, an XML sitemap and an llms.txt file.
Yes, it's free, with no sign-up and no email required. We only read public files: your robots.txt, llms.txt, sitemap and homepage.
No. The instant check covers crawl-readiness, which is the first of five dimensions in answer engine optimization (AEO). Being recommended also depends on how quotable your content is, what third-party sources say about you, whether AI describes you accurately, and how you compare with competitors on real buyer prompts. The free Agent Blindness Report covers all five.
It's a business decision. Blocking training crawlers such as GPTBot or Google-Extended limits how your content is used to train models. Blocking search and retrieval crawlers such as OAI-SearchBot, PerplexityBot, Googlebot or Bingbot keeps you out of AI answers altogether. The check shows each crawler separately, so you can see exactly what your robots.txt allows.
AGI Search Labs, an answer engine optimization (AEO) and GEO agency that helps mid-size and large B2B companies get found, cited and recommended by AI assistants.