AI Crawler Access Check
Privacy policy. Last updated 8 November 2026.
This browser extension shows which AI crawlers a website allows in its robots.txt, and whether the site publishes llms.txt, AGENTS.md and a sitemap. In short: it reads the site you have open and shows you the result. Nothing is sent to us.
What it reads
Only when you press "Check this site", and only that website's own public files: /robots.txt, /llms.txt, /llms-full.txt, /AGENTS.md, /sitemap.xml and the page you are on. It requests them without your cookies, the way any visitor's browser would, and reads the robots tags of the open page.
What it does not do
- It does not run on any page until you click it, and never in the background.
- It does not contact any website other than the one open in your tab.
- It does not collect, store, send or sell personal information or browsing history.
- It has no analytics, tracking, adverts or accounts, and no server of ours is involved.
Permissions
- Active tab and scripting: to read the site in the tab you are on, only after you press the button.
Storage
Nothing is stored. Results disappear when you close the window.
Contact
Questions: taz@aitaz.com. Made by Himanshu Bhatia (Taz).