What it does
CompletionKit runs a prompt against the items in a dataset and scores each resulting output on a 1-5 scale, using an LLM as the judge. It is provided as an MCP server, so it can be used from MCP-compatible clients.
Safety
Our team has not reviewed this resource. Only automated rules checked it; resources with high-risk signals are not published. These are signals, not a guarantee that installing it is safe. Try it in a sandbox project first.
- Runs code or changes an assistant's behaviour
Sources
- Official MCP Registry first seen 13 Nov 2026 · last seen 13 Nov 2026 · its page on the source
CompletionKit
Prompt evals over MCP: run a prompt on your dataset, score each output 1-5 with an LLM judge.
v1.0.0As shown on registry.modelcontextprotocol.io when we last read it