Resources
Practical, tested guides to answer engine optimization (AEO): which AI crawlers to let in, how to set up robots.txt and Cloudflare rules, what llms.txt and schema actually do, and how to measure your visibility in ChatGPT, Copilot, Gemini and Google AI Overviews.
GPTBot vs OAI-SearchBot vs ChatGPT-User, and why blocking Google-Extended doesn't keep you out of AI Overviews.
Crawler accessMost AI crawlers don't run JavaScript. How to test what's in your raw HTML, and how to fix it.
Cloudflare & hostingCopy-paste rules to let verified AI crawlers through, block fake GPTBots, and limit training to chosen folders.
Machine-readable filesThe format, who actually reads it in 2026, and whether a B2B site needs one. With a copy-paste example.
Crawler accessEvery AI crawler that matters, what it does, whether it obeys robots.txt, and what blocking it really costs you.
Crawler accessFour ready-made templates: allow all, search-only, block training, block all.
Cloudflare & hostingAI Crawl Control, the new Search/Agent/Training settings, the September 15, 2026 defaults and managed robots.txt.
MeasurementWhat GA4's new AI Assistant channel misses, the custom channel and regex that fix it, and the reports to build.
Published IP ranges, reverse DNS and the log filters that separate real AI crawlers from impostors.
Why sites that live on leads usually shouldn't, and who might.
Security plugins, hosting platforms, CDNs, geo-blocking and a leftover staging noindex.
Organization, Service, Product and FAQ markup: what structured data does and doesn't do for AI.
Why Bing's index matters for Microsoft Copilot, and how to get new pages picked up in hours.
Retrieval, query fan-out and source selection: what happens between a buyer's question and the answer.
Direct claims up front, specs, defined terms and proof: a page structure AI can quote.
How answer engines judge recency, and how to keep important pages current without churn.
Where wrong answers come from, and the corrections that actually change them.
Access, quotability, corroboration, accuracy and share of voice: our scoring method, in full.
Formats, bidding, measurement caveats, and which B2B companies should run a first test.
We ran real sourcing prompts across six AI assistants. Here's who gets named, and why.
No guides in this topic yet.
Get a free Agent Blindness Report: your AEO baseline across six AI assistants, delivered in 48 hours.