--- title: "AI crawler access checker: is GPTBot, ClaudeBot or PerplexityBot blocked? | PostCliq" description: "Check which AI crawlers your robots.txt allows: GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended and more. See the exact rule and whether a firewall blocks them." url: "https://postcliq.com/free-tools/ai-crawler-access-checker" --- [Free tools](https://postcliq.com/free-tools) · Instant check # Which AI crawlers can read my site? 20 AI bots, one robots.txt. Type your website. We read its robots.txt and tell you, for each of 20 AI crawlers, whether it may read your site, which rule decides it, and whether your firewall is turning bots away before robots.txt even matters. Free No sign-up Answer in seconds Reads your robots.txt and loads your homepage once. Nothing is stored. The free plan ## One check is a clue. The free plan is the whole picture. - A full audit of up to 50 pages, every week - The three fixes that win the most enquiries, with the evidence - Speed, security, AI visibility, tracking and the enquiry path in one report - Connect Google Analytics, Search Console and Clarity to see what visitors really do - One website free, or five client sites for an agency. No card. **Free** No card. No trial that runs out. [Create your free account](https://postcliq.com/login?mode=signup) [Already have an account? Log in](https://postcliq.com/login) ## Questions people ask Should I block AI crawlers? Block the training crawlers if you do not want your content used to train models. Think twice before blocking the search and user agents (OAI-SearchBot, ChatGPT-User, Claude-SearchBot, PerplexityBot): they are how AI answers find, cite and link to you. robots.txt allows them. Why might they still be blocked? Firewalls and bot protection (Cloudflare, Kinsta, Sucuri and others) often challenge automated visitors before robots.txt is read. We flag it when your site challenged our own honest crawler. What is a Content-Signal line? A newer robots.txt line, popularised by Cloudflare, that says whether content may be used for search, AI answers or AI training. We show it when your file has one. ## More instant checks [**What is this site built with?** See the platform behind any website, with the proof. Run it free](https://postcliq.com/free-tools/what-cms-is-this-site) [**Where is this site hosted?** Find the host, the CDN and who runs the DNS and email. Run it free](https://postcliq.com/free-tools/where-is-this-site-hosted) [**Grade my website security** Get a security grade for headers, SSL and email spoofing. Run it free](https://postcliq.com/free-tools/website-security-grade) [**Can AI see your page?** See what ChatGPT and Claude actually read on your page. Run it free](https://postcliq.com/free-tools/can-ai-see-your-page) [**Can an AI agent read my site?** Score how ready your site is for AI agents, out of 100. Run it free](https://postcliq.com/free-tools/can-ai-agents-read-my-site) [**Is my website slow?** Find the nine things that most often slow a page down. Run it free](https://postcliq.com/free-tools/website-speed-test) [**Can visitors contact you?** Check the path from visit to enquiry, step by step. Run it free](https://postcliq.com/free-tools/can-visitors-contact-you) [**Is my tracking installed?** See which analytics and ad tags are on the page. Run it free](https://postcliq.com/free-tools/is-my-tracking-installed) [**How does my page look in Google?** See your Google result and LinkedIn card before others do. Run it free](https://postcliq.com/free-tools/google-and-social-preview) [**Check my structured data** Find broken structured data and what Google can’t read. Run it free](https://postcliq.com/free-tools/schema-markup-checker) [**Do my redirects work?** Check every version of your address lands in one place. Run it free](https://postcliq.com/free-tools/redirect-checker) ## Stop guessing. See what stops visitors enquiring. Create your free PostCliq account and get your full website audit in minutes. [Sign up free](https://postcliq.com/login?mode=signup) [Log in](https://postcliq.com/login)