flakemap — inspection report

Test reliability across CI history, computed from JUnit, NUnit XML and TRX.

runs 3 tests 6 run range 00 → 02
3 input / ordering warnings — inspect before using this report
0broken
1flaky
0healthy
5insufficient data
1test-runs passed on retry
1test-runs excluded

Test × run heatmap

Tests under C

recovered INTERMITTENT 0%

C.recovered

Final failure rate (95% CI)0% [0%–79%] · 0 of 1 runs
Usable outcomesruns: 1; skipped: 0; excluded: 0
Passed on retry1 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rateunavailable: no usable consecutive pairs
Same-context rerun disagreementno commits with multiple runs observed
Flakiness score0.020
Activity1 run with observed failures (1 passed on retry) in 1 separate stretch: too few to place.
Timing observations (without retries)0
Failure messages
  • first attempt failed ×1

Recorded evidence

Sources identify a file and its 1-based testcase position. Failure records follow XML order. Attempt timing and total retry cost are not inferred.

01 — recovered

01/report.xml :: testcase 2 — reported pass

2 recorded attempts; 1 failed.

  • <flakyFailure> first attempt failed
ordinary 0%

C.ordinary

Final failure rate (95% CI)0% [0%–79%] · 0 of 1 runs
Usable outcomesruns: 1; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rateunavailable: no usable consecutive pairs
Same-context rerun disagreementno commits with multiple runs observed
Flakiness score0.000
Timing observations (without retries)1
sparseTiming 0%

C.sparseTiming

Final failure rate (95% CI)0% [0%–66%] · 0 of 2 runs
Usable outcomesruns: 2; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate0% of 1 usable consecutive pairs
Same-context rerun disagreementno commits with multiple runs observed
Flakiness score0.000
Duration trend (without retries)+2000.0 ms/history run
Timing observations (without retries)2
closedFailure 100%

C.closedFailure

Final failure rate (95% CI)100% [21%–100%] · 1 of 1 runs
Usable outcomesruns: 1; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rateunavailable: no usable consecutive pairs
Same-context rerun disagreementno commits with multiple runs observed
Flakiness score0.000
Activity1 failures: too few to place.
Timing observations (without retries)1
Failure messages
  • Expected <img src=x onerror=alert(1)> to stay literal ×1

Failures, newest first

RunSame commit, other runsOther tests failedNamed in output, or message
01
unknown time		synthetic-in
no other run		noneExpected <img src=x onerror=alert(1)> to stay literal
qualitativeUnknown n/a

C.qualitativeUnknown

Final failure rate (95% CI)unknown: no usable outcomes
Usable outcomesruns: 0; skipped: 0; excluded: 1
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rateunavailable: no usable consecutive pairs
Same-context rerun disagreementno commits with multiple runs observed
Flakiness score0.000
ActivityUnavailable: ambiguous outcomes interrupt the failure history.
Timing observations (without retries)0

Recorded evidence

Sources identify a file and its 1-based testcase position. Failure records follow XML order. Attempt timing and total retry cost are not inferred.

02 — excluded

TRX outcome 'Completed' does not establish pass, failure or skip

02/report.trx :: testcase 2 — reported unknown

Execution ended; the reporter supplied no qualitative outcome.

invalidDuration 0%

C.invalidDuration

Final failure rate (95% CI)0% [0%–79%] · 0 of 1 runs
Usable outcomesruns: 1; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rateunavailable: no usable consecutive pairs
Same-context rerun disagreementno commits with multiple runs observed
Flakiness score0.000
Timing observations (without retries)0
pass passed on retry fail error skip not run unknown / excluded Rates use the final outcome of each run; retry attempts do not increase the sample size. Rows sorted broken → new → flaky → quiet → insufficient data → healthy, then by score. Columns are runs in chronological order. Click a row for detail. Hover a cell for the run.