Free tool · no signup

AI Crawler robots.txt Generator

Decide exactly which AI crawlers can read your site — the answer engines that cite you and the bots that only train on you — then copy a ready-to-paste robots.txt block.

Runs entirely in your browser. Nothing is uploaded, nothing is stored.

AI answer engines

These bots power AI search results — allowing them is how you get cited.

AI training crawlers

These harvest content to train models. Blocking them does not affect citations.

Your robots.txt
 

Checked = allowed to crawl. Unchecked = blocked. Add these lines to the robots.txt at your domain root. robots.txt is an honor-system directive — most named AI crawlers respect it, but it is not an enforced block.

The paid deep audit is no longer offered and can't be purchased. The free scan is still available.
Bot Traffic by AttractOS