What it does
flakyguard takes per-test outcomes from a set of CI runs and builds a record for each test: how many runs included it and how many times it passed, failed or was skipped. Skipped results are recorded but never count as evidence. By default a test needs two evidence runs before it receives a verdict of stable pass, stable fail or flaky; until then it is marked insufficient data. Its flakiness rate is the share of the minority outcome among evidence runs, rounded to four decimal places.
It suits teams that want evidence about a suspect test rather than impressions, and that need to decide which flaky tests to quarantine. Flaky tests whose rate meets the quarantine threshold (0.5 by default) appear in a list ordered worst first, with the pass and fail counts behind each rate. The overall verdict is quarantine_recommended when that list is non-empty, and clean otherwise.
Analysis runs locally on the runs you supply, with no network access, no configuration and no history kept between calls. It is available as a CLI that reads an args.json file and prints JSON, and as an MCP server exposing an analyze_test_flakiness tool that takes runs, min_runs and quarantine_threshold.
Limitations and requirements
Each run must contain results, every status must be passed, failed or skipped, and a test may appear only once per run. Invalid input, including an unreadable or invalid input file, is rejected with an error naming the offending path, and no partial analysis is produced.
Safety
Our team has not reviewed this resource. Only automated rules checked it; resources with high-risk signals are not published. These are signals, not a guarantee that installing it is safe. Try it in a sandbox project first.
- Runs code or changes an assistant's behaviour
Sources
- Official MCP Registry first seen 13 Nov 2026 · last seen 13 Nov 2026 · its page on the source
io.github.CloudCorpRecords/flakyguard
Flaky-test evidence tracker: per-test pass/fail history, flakiness rates, and a quarantine list.
v0.1.0As shown on registry.modelcontextprotocol.io when we last read it