InspectGeo

All checks › Citable by AI

AI search crawlers allowed

Why it matters

ChatGPT, Perplexity, Claude, Google and Bing only cite what their search crawlers can read. If robots.txt or a firewall blocks those crawlers, the site drops out of the answers, however good its content is. Blocking TRAINING crawlers (GPTBot, CCBot, Google-Extended) is a different matter: it is a legitimate choice and does not remove the site from search, so it does not count here. The test reads robots.txt and makes one request with the ChatGPT search crawler user agent, to catch a CDN or firewall that blocks AI crawlers even when robots.txt allows them.

Want to see how your site does?

The free scan runs this and every other check in about 30 seconds and shows the evidence for each one.

Scan my site for free

Other checks in Citable by AI