AI crawler access checker
Can ChatGPT, Perplexity, Claude and Google's AI read your store? See which AI crawlers your robots.txt lets in, what your pages tell them, and what your llms.txt says.
We read your robots.txt, the page you enter and your llms.txt, live. Public sites only.
Search crawlers and training crawlers are different
AI companies run separate crawlers for separate jobs. Search crawlers such as OAI-SearchBot, PerplexityBot and Claude-SearchBot decide whether your store can appear in, and be cited by, AI answers. Training crawlers such as GPTBot, ClaudeBot and CCBot only collect pages for training models, and Google-Extended and Applebot-Extended are robots.txt switches for the same purpose. Blocking a training crawler doesn't take you out of AI answers; blocking a search crawler does.
Google's AI Overviews and AI Mode use Googlebot, so they follow the same rules as Google Search. Microsoft Copilot answers draw on Bing, so Bingbot matters there.
What this check can't see
- Firewalls and bot protection can block a crawler at the network level before robots.txt comes into it.
- Fetchers that open a page because a user asked, such as ChatGPT-User and Perplexity-User, may not follow robots.txt, as their operators say.
- Whether an assistant actually cites you. That depends on your content, which is what the Shopify product grader checks.
About llms.txt
llms.txt is a proposed plain-text guide to a site's key pages for AI tools. Some developer tools read it, but no major AI search engine has said it uses the file, so treat it as optional. Shopify now serves its own llms.txt on every store, with instructions for AI shopping agents on searching and checking out.
See which AI assistants actually visit
Yieldso shows the visits AI assistants send your store, the AI crawlers that fetch its files, and the orders AI-referred shoppers place.
Free plan available · uninstall any time · no card required
Free plan, no card — your products scored before you decide on anything.
