MCP servers · cloudcorprecords

evalsnap: snapshot diff for agent and tool outputs

Compares a baseline and a current eval snapshot matched by case_id, reporting changed outputs, score regressions and a pass/fail verdict.

This text was machine-translated from the publisher's own information and has not been checked by a human editor. The publisher's original text is the reference.

This resource was imported automatically from the sources listed below and has not been reviewed by the AI Gate team yet. The description is the publisher's own, as published. Check the repository before installing.

What it does

evalsnap compares two snapshots of case outputs, a baseline run and a current run, matched by case_id. For each matched case it reports whether the output is unchanged or changed under exact string equality, along with the score delta and duration delta. Either delta is null when one side did not record that measurement. A case is flagged as a regression only when its score went down. The result also lists added and removed cases, the sorted regressed case ids, the count of improved cases, and averages for each side over the matched cases that have a score on both sides. The verdict is fail when at least one regression exists and pass otherwise. Added and removed cases are reported but do not fail the verdict on their own. Deltas and averages are rounded to four decimal places.

It is useful after re-running an agent or tool when the answers look slightly different and you need to know whether any scores got worse. It is available as a command-line tool that prints JSON, and as an MCP server exposing a diff_snapshots tool.

The computation is local and pure: it makes no network calls, needs no configuration, and reads only the snapshots you pass in. The CLI takes an args.json file holding the full arguments, and exits with 0 on success, 1 on a runtime error, and 2 on a usage error. The MCP tool takes baseline and current arrays of entries shaped as case_id, output, and optional score and duration_ms.

Limitations and requirements

Invalid input is rejected with an error naming the offending path and side, and no partial diff is produced. Rejected input includes an empty snapshot, a case without an id or output, a duplicate id within one side, a non-numeric score, and a negative duration. Running it through an MCP client requires adding a client configuration entry.

Safety

Our team has not reviewed this resource. Only automated rules checked it; resources with high-risk signals are not published. These are signals, not a guarantee that installing it is safe. Try it in a sandbox project first.

  • Runs code or changes an assistant's behaviour

Sources

  • Official MCP Registry first seen 13 Nov 2026 · last seen 13 Nov 2026 · its page on the source
    io.github.CloudCorpRecords/evalsnap

    Snapshot diff for agent and tool outputs: changed cases, score regressions, pass/fail verdict.

    v0.1.0
    As shown on registry.modelcontextprotocol.io when we last read it
MCP servers
docker

Docker Hub MCP Server

Docker's MCP server that helps an AI assistant find and compare container images on Docker Hub and, with your token, manage your own repositories and tags.

171 GitHub starsCloud & DevOpsSoftware development
Updated 13 Nov 2026
MCP servers
awslabs

MCP servers for AWS (AWS Labs)

A large open-source collection of MCP servers from AWS Labs for building and operating on AWS: documentation, infrastructure, databases, AI services, cost and more.

9.9K GitHub starsCloud & DevOpsData & databases
Updated 17 Nov 2026
MCP servers
firecrawl

Firecrawl MCP Server (web search and scraping)

Firecrawl's MCP server that lets an AI assistant search the web, turn pages and PDFs into clean Markdown, crawl sites and interact with dynamic pages.

7.8K GitHub starsWeb, search & browserProductivity & automation
Updated 17 Nov 2026
MCP servers
microsoft

Playwright MCP (browser automation)

Microsoft's MCP server that lets an AI assistant open web pages, click, type and read them through a real browser, using the page structure instead of screenshots.

39.6K GitHub starsTesting & QAWeb, search & browser
Updated 18 Nov 2026
evalsnap: snapshot diff for agent and tool outputs | AI Gate Discover