Is my site AI-ready?
Check whether AI crawlers may access your site and whether your content is structured machine-readably.
Is my site AI-ready? — the AI readiness check
AI assistants such as ChatGPT, Perplexity, Gemini and Claude read websites through their own crawlers (GPTBot, ChatGPT-User, OAI-SearchBot, PerplexityBot, ClaudeBot, Google-Extended …). This check loads your robots.txt, your llms.txt and your homepage live and tests four things: (1) whether the known AI crawlers are allowed or blocked in robots.txt, (2) whether an llms.txt exists that structures your content for AI models, (3) whether the page serves structured data (JSON-LD/Schema.org), and (4) whether a reachable XML sitemap is referenced. From that the tool computes an AI-readiness score from 0 to 100 with concrete recommendations. Nothing is stored; the fetch happens SSRF-safe server-side.
Typical use cases
- Content team checks before a relaunch whether the major AI crawlers are even allowed to read the site
- SEO owners verify that an llms.txt exists and that structured data is being served
- Agency documents the AI-visibility status quo for a client as a before/after comparison
- Operator wants to deliberately exclude AI crawlers and verifies that the robots.txt rules apply
Frequently asked questions
What is an llms.txt and do I need it?
llms.txt is a proposed Markdown file in the root directory that structures the key content and links of your site for an AI model. It is a voluntary proposal, not an official standard and not a ranking factor — its effect is currently disputed and not evaluated by all providers. It does no harm, but a reliable benefit is not proven.
How is the AI readiness score calculated?
The 0-to-100 score weights four signals: AI-crawler permission in robots.txt, presence of an llms.txt, structured data (JSON-LD/Schema.org) and a reachable sitemap. It is a heuristic orientation, not a guarantee of any particular appearance in AI answers.
Should I allow or block AI crawlers?
It depends on your goal. To be visible in AI answers, allow the reading crawlers. To keep content out of training or AI display, block them selectively via robots.txt. Note: robots.txt is a request, not a technical lock — reputable crawlers honour it, others may not.
Are my URL and result stored?
No. The page is fetched in memory and the result returned directly to you. We store neither the checked domain nor the score. The fetch runs SSRF-safe server-side — internal addresses are blocked.
Does a high score guarantee I appear in ChatGPT?
No. The score only shows whether the technical basics are in place. Whether and how an AI system actually cites your content depends on many factors that no tool can influence or guarantee.
How does this differ from a normal SEO check?
An SEO check targets classic search engines. This check specifically looks at the AI crawlers and signals that can be relevant for evaluation by AI assistants — i.e. AI-crawler rules, llms.txt and machine-readable structure. The two complement each other.
Related tools
Continuous monitoring vs. one-shot?
XICTRAQ monitors uptime, SSL, security headers, GDPR and performance 24/7. Free plan, no credit card.