Guides
Practical, data-grounded guides for making websites work in the agentic era. Every claim traces to our own measurements across 48,005 probed domains and thousands of audits.
What is llms.txt - and how to add it
The format, a copy-paste example, WordPress plugins, verification - and the honest caveat that Google ignores it. With live adoption data (6.4% of 48,005 sites).
The agentic readiness checklist
All 30 measurable signals - agent interaction, machine extraction, structured data, AI discovery, trust - with how to fix each.
AI crawlers explained
GPTBot, ClaudeBot, PerplexityBot, Google-Extended: what each feeds, and three coherent robots.txt policies to choose from.
Check any domain → - every guide's advice is measured by the free 30-check audit