Mydentify AI Crawler Access Checker 1.1.4

A dependency-free Node.js checker and browser evaluator for inspecting how a public page treats documented OpenAI and Anthropic crawler names. It reads robots.txt, checks page-level directives and X-Robots-Tag headers, and sends labeled user-agent requests. Results describe observable handling only; probes originate from the caller and do not prove provider-IP behavior, indexing, training, or authorship.

Tags ai-crawlers robots-txt seo developer-tools security artificial-intelligence security software-development
License MITL
State stable

Recent Releases

1.1.414 Aug 2026 07:33 minor feature: Adds a typed JSR library entry point and documents the JSR import path. CLI behavior is unchanged; user-agent probes do not prove provider-IP access.