What it does
Scrape-LE analyses robots.txt content and reports whether a given path may be crawled. The publisher's description gives no further detail on usage or setup.
Safety
Our team has not reviewed this resource. Only automated rules checked it; resources with high-risk signals are not published. These are signals, not a guarantee that installing it is safe. Try it in a sandbox project first.
- Runs code or changes an assistant's behaviour
Sources
- Official MCP Registry first seen 13 Nov 2026 · last seen 13 Nov 2026 · its page on the source
Scrape-LE
Analyse robots.txt content and report whether a path may be crawled.
v2.6.0As shown on registry.modelcontextprotocol.io when we last read it