surefire-001 — recovered
surefire-001/report.xml :: testcase 4 — reported pass
2 recorded attempts; 1 failed.
<flakyError>worker unavailable
0broken
2flaky
0healthy
4insufficient data
2test-runs passed on retry
0test-runs excluded
Tests that fail together
4 tests in 2 exact outcome cohorts. Each group has the same normalized outcomes, retry states, skips and missing runs. A shared history is a lead to investigate, not proof of a common cause.
Download all shared-outcome evidenceShowing 2 of 2 cohorts, ordered by affected test-runs. Final failures and passed-on-retry results remain separate.
2 tests share 1 final-failure runs and 0 recovered runs
Matching run history
- Retries exhausted (1)
surefire-001
Members (2)
Showing 2 of 2 affected test-runs. Source positions are 1-based result ordinals. Long text and retry lists are previewed; the JSON download retains every record.
Scroll the evidence table horizontally to inspect every column.
| Run / environment | Test | Reported outcome | Source and message |
|---|---|---|---|
surefire-001Environment not recorded | alwaysErrors | error; exhausted; 3 attempts | surefire-001/report.xml :: testcase 2error: invalid configuration rerunError: invalid configuration rerunError: invalid configuration |
surefire-001Environment not recorded | alwaysFails | fail; exhausted; 3 attempts | surefire-001/report.xml :: testcase 1failure: expected revision was not deployed rerunFailure: expected revision was not deployed rerunFailure: expected revision was not deployed |
2 tests share 0 final-failure runs and 1 recovered runs
Matching run history
- Passed on retry (1)
surefire-001
Members (2)
Showing 2 of 2 affected test-runs. Source positions are 1-based result ordinals. Long text and retry lists are previewed; the JSON download retains every record.
Scroll the evidence table horizontally to inspect every column.
| Run / environment | Test | Reported outcome | Source and message |
|---|---|---|---|
surefire-001Environment not recorded | recoversAfterTwoFailures | pass; recovered; 3 attempts | surefire-001/report.xml :: testcase 5flakyFailure: connection not ready flakyFailure: connection not ready |
surefire-001Environment not recorded | recoversFromError | pass; recovered; 2 attempts | surefire-001/report.xml :: testcase 4flakyError: worker unavailable |
Test × run heatmap
Tests under example.RetryEvidenceTest
recoversFromError INTERMITTENT 0%
example.RetryEvidenceTest.recoversFromError
Final failure rate (95% CI)0% [0%–79%] · 0 of 1 runs
Usable outcomesruns: 1; skipped: 0; excluded: 0
Passed on retry1 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rateunavailable: no usable consecutive pairs
Same-context rerun disagreementno commits with multiple runs observed
Flakiness score0.020
Activity1 run with observed failures (1 passed on retry) in 1 separate stretch: too few to place.
Timing observations (without retries)0
Failure messages
Recorded evidence
Sources identify a file and its 1-based testcase position. Failure records follow XML order. Attempt timing and total retry cost are not inferred.
recoversAfterTwoFailures INTERMITTENT 0%
example.RetryEvidenceTest.recoversAfterTwoFailures
Final failure rate (95% CI)0% [0%–79%] · 0 of 1 runs
Usable outcomesruns: 1; skipped: 0; excluded: 0
Passed on retry1 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rateunavailable: no usable consecutive pairs
Same-context rerun disagreementno commits with multiple runs observed
Flakiness score0.020
Activity1 run with observed failures (1 passed on retry) in 1 separate stretch: too few to place.
Timing observations (without retries)0
Failure messages
Recorded evidence
Sources identify a file and its 1-based testcase position. Failure records follow XML order. Attempt timing and total retry cost are not inferred.
surefire-001 — recovered
surefire-001/report.xml :: testcase 5 — reported pass
3 recorded attempts; 2 failed.
<flakyFailure>connection not ready<flakyFailure>connection not ready
alwaysFails 100%
example.RetryEvidenceTest.alwaysFails
Final failure rate (95% CI)100% [21%–100%] · 1 of 1 runs
Usable outcomesruns: 1; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion1 (every recorded attempt failed)
Flip rateunavailable: no usable consecutive pairs
Same-context rerun disagreementno commits with multiple runs observed
Flakiness score0.000
Activity1 failures: too few to place.
Timing observations (without retries)0
Failure messages
Failures, newest first
| Run | Same commit, other runs | Other tests failed | Named in output, or message |
|---|---|---|---|
surefire-001unknown time | commit not recorded | 1 | expected revision was not deployed |
Recorded evidence
Sources identify a file and its 1-based testcase position. Failure records follow XML order. Attempt timing and total retry cost are not inferred.
surefire-001 — exhausted
surefire-001/report.xml :: testcase 1 — reported fail
3 recorded attempts; 3 failed.
<failure>expected revision was not deployed<rerunFailure>expected revision was not deployed<rerunFailure>expected revision was not deployed
alwaysErrors 100%
example.RetryEvidenceTest.alwaysErrors
Final failure rate (95% CI)100% [21%–100%] · 1 of 1 runs
Usable outcomesruns: 1; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion1 (every recorded attempt failed)
Flip rateunavailable: no usable consecutive pairs
Same-context rerun disagreementno commits with multiple runs observed
Flakiness score0.000
Activity1 failures: too few to place.
Timing observations (without retries)0
Failure messages
Failures, newest first
| Run | Same commit, other runs | Other tests failed | Named in output, or message |
|---|---|---|---|
surefire-001unknown time | commit not recorded | 1 | invalid configuration |
Recorded evidence
Sources identify a file and its 1-based testcase position. Failure records follow XML order. Attempt timing and total retry cost are not inferred.
surefire-001 — exhausted
surefire-001/report.xml :: testcase 2 — reported error
3 recorded attempts; 3 failed.
<error>invalid configuration<rerunError>invalid configuration<rerunError>invalid configuration
alwaysPasses 0%
example.RetryEvidenceTest.alwaysPasses
Final failure rate (95% CI)0% [0%–79%] · 0 of 1 runs
Usable outcomesruns: 1; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rateunavailable: no usable consecutive pairs
Same-context rerun disagreementno commits with multiple runs observed
Flakiness score0.000
Timing observations (without retries)1
skipped n/a
example.RetryEvidenceTest.skipped
Final failure rate (95% CI)unknown: no usable outcomes
Usable outcomesruns: 0; skipped: 1; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rateunavailable: no usable consecutive pairs
Same-context rerun disagreementno commits with multiple runs observed
Flakiness score0.000
Timing observations (without retries)0
pass
passed on retry
fail
error
skip
not run
unknown / excluded
Rates use the final outcome of each run; retry attempts do not increase the sample size.
Rows sorted broken → new → flaky → quiet → insufficient data → healthy, then by score. Columns are runs in chronological order. Click a row for detail. Hover a cell for the run.