AI Visibility Check
See in one screen whether AI crawlers are allowed to read your site, straight from robots.txt.
This tool reads your site's robots.txt and shows the permission status of four AI crawlers: OpenAI's GPTBot, Anthropic's ClaudeBot, Perplexity's PerplexityBot, and Google-Extended, which controls whether Google's own AI products (AI Overviews, Gemini) can use your content. If a bot is blocked, that service can't see your content and can't cite you in its answers.
It also checks three further points: whether you have an llms.txt file (an emerging convention for summarising your site to AI systems, not yet an official standard), whether your sitemap.xml is reachable, and whether your pages carry structured data (schema.org markup). Structured data helps both search engines and AI systems understand exactly what your content is, an article, a product, a set of FAQs.
This check only reads permission settings; it doesn't measure how often bots actually visit your site or how often you show up in AI answers. Allowing a bot in robots.txt doesn't guarantee visibility, it only removes the block, the content itself still needs to be open, accurate, and easy to cite.
How to use it
- Enter your site's address.
- Start the check and let it read robots.txt automatically.
- See which of the four bots, if any, are blocked.
- Review the status of llms.txt, your sitemap, and structured data.
- Remove the block for any bot you find disallowed in robots.txt.
FAQ
Will blocking GPTBot reduce my traffic?
Blocking GPTBot stops ChatGPT from using your content for training or live answers; it has no effect on your existing search traffic, since that's handled by a separate bot, Googlebot.
Is llms.txt mandatory?
No, it isn't an official standard yet; some sites add it to offer AI systems a content summary, but no search engine or AI system is guaranteed to read it.
Will blocking Google-Extended drop me from Google Search?
No, Google-Extended only controls content use for Gemini and AI Overviews; it has no effect on your visibility in classic Google Search, which is governed by Googlebot.
Can't I appear in AI answers without structured data?
You can, but structured data makes the type and relationships within your content clearer, which raises the odds of being cited accurately.
