Audit every signal your site sends to AI crawlers in one click, robots.txt, llms.txt, ai.txt and meta tags. See exactly which AI bots are blocked, which are allowed, and what to fix.
/robots.txt, /llms.txt, /ai.txt and the page's meta tags.
| AI crawler | robots.txt | llms.txt | ai.txt | meta | Verdict |
|---|
Paste a homepage or a specific page URL. We'll automatically resolve the domain and fetch all the AI-relevant signals.
For every major AI crawler, GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot and more, see the signal in robots.txt, llms.txt, ai.txt and meta tags side by side.
Use the verdict column to spot which bots are unintentionally allowed (or blocked) and update robots.txt, llms.txt or meta tags to match your policy.
This tool covers the technical opt-out signals. Get a free audit that also covers brand mentions, citation coverage and AI answer share across ChatGPT, Perplexity and Google AI Overviews.