Free tool · no signup

Is your site blocking AI crawlers?

If GPTBot or ClaudeBot can't read your site, ChatGPT and Claude can't cite it. Check all six AI crawlers against your robots.txt — instantly, free, no account.

~2 seconds · robots.txt + llms.txt · nothing stored on your site

WHY IT MATTERS

Blocked crawler, invisible business.

AI assistants can only recommend what their crawlers have read. A single inherited robots.txt rule — or an over-eager bot blocker — silently removes you from ChatGPT, Claude, Perplexity and Gemini answers. Most owners have never checked; it takes two seconds above.

THE FIX

Unblocking takes one robots.txt edit.

If a crawler shows as blocked and you want AI visibility, allow it explicitly in your robots.txt:

User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

Blocking is also a legitimate choice (e.g. to opt out of AI training) — the point is choosing it deliberately, not inheriting it by accident.

Crawler questions

Questions, answered.

It fetches your robots.txt and tests the rules against six AI crawlers — GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, Google-Extended (Gemini), CCBot (Common Crawl) and Applebot-Extended — and checks whether you publish an llms.txt. Two requests, nothing installed, nothing stored on your site.

Assistants can only cite what their crawlers have read. Block GPTBot and ChatGPT's browsing can't see your site; block them all and you're invisible across AI search — regardless of how well you rank on Google.

Not necessarily — blocking is a legitimate choice, for example to opt out of AI training (Google-Extended, CCBot). The problem is inheriting a block by accident. Decide per crawler, deliberately.

Yes — this check is instant and completely ungated. The full AI Search Audit (AEO, GEO and AIO scores plus a prioritized fix list) needs a free account: 3 audits a month, no card.

Access is step one. Citability is the game.

The full AI Search Audit scores all three pillars — AEO, GEO and AIO — with a prioritized fix list.

Run the full AI Search Audit