MCP servers · unitedideas

ActableSite AI Crawler Monitor

MCP server that checks AI crawler robots.txt policy and monitors changes to a public site's policy, sitemap and llms.txt files.

This text was machine-translated from the publisher's own information and has not been checked by a human editor. The publisher's original text is the reference.

This resource was imported automatically from the sources listed below and has not been reviewed by the AI Gate team yet. The description is the publisher's own, as published. Check the repository before installing.

The publisher marked this resource as deprecated. Prefer the alternatives below.

What it does

The server checks the robots.txt policy that applies to AI crawlers and watches a public website's policy, sitemap and llms.txt files for changes. The publisher's description covers these two functions and does not detail how the checks are run or how changes are reported.

Safety

Our team has not reviewed this resource. Only automated rules checked it; resources with high-risk signals are not published. These are signals, not a guarantee that installing it is safe. Try it in a sandbox project first.

  • Runs code or changes an assistant's behaviour

Sources

  • Official MCP Registry first seen 13 Nov 2026 · last seen 13 Nov 2026 · its page on the source
    ActableSite AI Crawler Monitor

    Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

    v1.4.1
    As shown on registry.modelcontextprotocol.io when we last read it
MCP servers
docker

Docker Hub MCP Server

Docker's MCP server that helps an AI assistant find and compare container images on Docker Hub and, with your token, manage your own repositories and tags.

171 GitHub starsCloud & DevOpsSoftware development
Updated 13 Nov 2026
MCP servers
awslabs

MCP servers for AWS (AWS Labs)

A large open-source collection of MCP servers from AWS Labs for building and operating on AWS: documentation, infrastructure, databases, AI services, cost and more.

9.9K GitHub starsCloud & DevOpsData & databases
Updated 17 Nov 2026
MCP servers
firecrawl

Firecrawl MCP Server (web search and scraping)

Firecrawl's MCP server that lets an AI assistant search the web, turn pages and PDFs into clean Markdown, crawl sites and interact with dynamic pages.

7.8K GitHub starsWeb, search & browserProductivity & automation
Updated 17 Nov 2026
MCP servers
neondatabase

Neon MCP Server (Postgres)

Neon's MCP server for managing Neon Postgres in plain language: create projects and branches, run queries and prepare schema migrations from your editor.

663 GitHub starsData & databasesSoftware development
Updated 19 Nov 2026
ActableSite AI Crawler Monitor | AI Gate Discover