What it does
CrawlSight reviews how a website presents itself to AI crawlers. It checks crawler access, generates and validates llms.txt files, and lints robots.txt.
It may suit someone who wants to review or prepare a site's setup for AI crawlers before publishing changes. The publisher's description is the only source available, so the entry does not cover further details.
Safety
Our team has not reviewed this resource. Only automated rules checked it; resources with high-risk signals are not published. These are signals, not a guarantee that installing it is safe. Try it in a sandbox project first.
- Runs code or changes an assistant's behaviour
Sources
- Official MCP Registry first seen 17 Nov 2026 · last seen 17 Nov 2026 · its page on the source
io.github.CloudCorpRecords/crawlsight
Check a site's AI visibility: crawler access, llms.txt generate and validate, robots.txt lint.
v0.1.0As shown on registry.modelcontextprotocol.io when we last read it