Mydentify AI Crawler Access Checker 1.1.4
Dependency-free browser and Node CLI for checking whether AI crawlers can access a page, how robots.txt rules match their user agents, and whether page or header directives block indexing. It reports clear evidence and explains that probes come from the caller rather than verified provider IP ranges.
| Tags | ai-crawlers robots-txt seo web-debugging privacy |
|---|---|
| License | MITL |
| State | stable |