Free SEO tools · AI search

AI crawler checker

Reads a site's robots.txt and shows which AI crawlers can access it: search bots that power ChatGPT, Claude and Perplexity answers, and training bots. Also checks for an llms.txt file.

Questions

What's the difference between search and training bots?Search bots fetch pages to answer a user's question right now and often cite you. Training bots collect content to train future models.

Related tools