flakemap · Shared outages

0broken

5flaky

1healthy

0insufficient data

0test-runs passed on retry

0test-runs excluded

Tests that fail together

3 tests in 1 exact outcome cohort. Each group has the same normalized outcomes, retry states, skips and missing runs. A shared history is a lead to investigate, not proof of a common cause.

Download all shared-outcome evidence

Showing 1 of 1 cohorts, ordered by affected test-runs. Final failures and passed-on-retry results remain separate.

3 tests share 3 final-failure runs and 0 recovered runs

Matching run history

Pass without retry (9): run-01, run-02, run-03, run-06, run-07, run-08, run-09, run-11, run-12
Final fail or error (3): run-04, run-05, run-10

Members (3)

tests.test_service.test_inventory_endpoint
tests.test_service.test_pricing_endpoint
tests.test_service.test_shipping_endpoint

Showing 9 of 9 affected test-runs. Source positions are 1-based result ordinals. Long text and retry lists are previewed; the JSON download retains every record.

Scroll the evidence table horizontally to inspect every column.

Original failures and recovered retries
Run / environment	Test	Reported outcome	Source and message
`run-04` controlled-loopback-capture / Linux	`test_inventory_endpoint`	fail	`run-04/report.xml :: testcase 1` AssertionError: Inventory endpoint returned HTTP 503
`run-04` controlled-loopback-capture / Linux	`test_pricing_endpoint`	fail	`run-04/report.xml :: testcase 3` AssertionError: Pricing endpoint returned HTTP 503
`run-04` controlled-loopback-capture / Linux	`test_shipping_endpoint`	fail	`run-04/report.xml :: testcase 2` AssertionError: Shipping endpoint returned HTTP 503
`run-05` controlled-loopback-capture / Linux	`test_inventory_endpoint`	fail	`run-05/report.xml :: testcase 1` AssertionError: Inventory endpoint returned HTTP 503
`run-05` controlled-loopback-capture / Linux	`test_pricing_endpoint`	fail	`run-05/report.xml :: testcase 3` AssertionError: Pricing endpoint returned HTTP 503
`run-05` controlled-loopback-capture / Linux	`test_shipping_endpoint`	fail	`run-05/report.xml :: testcase 2` AssertionError: Shipping endpoint returned HTTP 503
`run-10` controlled-loopback-capture / Linux	`test_inventory_endpoint`	fail	`run-10/report.xml :: testcase 1` AssertionError: Inventory endpoint returned HTTP 503
`run-10` controlled-loopback-capture / Linux	`test_pricing_endpoint`	fail	`run-10/report.xml :: testcase 3` AssertionError: Pricing endpoint returned HTTP 503
`run-10` controlled-loopback-capture / Linux	`test_shipping_endpoint`	fail	`run-10/report.xml :: testcase 2` AssertionError: Shipping endpoint returned HTTP 503

Test × run heatmap

Tests under tests.test_service

test_inventory_endpoint INTERMITTENT 25%

tests.test_service.test_inventory_endpoint

Final failure rate (95% CI)25% [8.9%–53%] · 3 of 12 runs

Usable outcomesruns: 12; skipped: 0; excluded: 0

Passed on retry0 (explicit failed attempts before a pass)

Retry exhaustion0 (every recorded attempt failed)

Flip rate36% of 11 usable consecutive pairs

Same-context rerun disagreementno commits with multiple runs observed

Flakiness score0.147

Activity3 failures in 2 separate stretches: too few to place.

Duration trend (without retries)-0.0 ms/history run

Timing observations (without retries)12

Duration × failure correlation+0.26

Failure rate by runnercontrolled-loopback-capture: 25% (n=12)

Failure rate by OSLinux: 25% (n=12)

Failure messages

AssertionError: Inventory endpoint returned HTTP 503 ×3

Failures, newest first

Run	Same commit, other runs	Other tests failed	Named in output, or message
`run-10` 2026-10-07 20:23	commit not recorded	2	`AssertionError: Inventory endpoint returned HTTP 503`
`run-05` 2026-10-07 20:23	commit not recorded	3	`AssertionError: Inventory endpoint returned HTTP 503`
`run-04` 2026-10-07 20:23	commit not recorded	2	`AssertionError: Inventory endpoint returned HTTP 503`

test_shipping_endpoint INTERMITTENT 25%

tests.test_service.test_shipping_endpoint

Final failure rate (95% CI)25% [8.9%–53%] · 3 of 12 runs

Usable outcomesruns: 12; skipped: 0; excluded: 0

Passed on retry0 (explicit failed attempts before a pass)

Retry exhaustion0 (every recorded attempt failed)

Flip rate36% of 11 usable consecutive pairs

Same-context rerun disagreementno commits with multiple runs observed

Flakiness score0.147

Activity3 failures in 2 separate stretches: too few to place.

Duration trend (without retries)-0.0 ms/history run

Timing observations (without retries)12

Duration × failure correlation+0.68

Failure rate by runnercontrolled-loopback-capture: 25% (n=12)

Failure rate by OSLinux: 25% (n=12)

Failure messages

AssertionError: Shipping endpoint returned HTTP 503 ×3

Failures, newest first

Run	Same commit, other runs	Other tests failed	Named in output, or message
`run-10` 2026-10-07 20:23	commit not recorded	2	`AssertionError: Shipping endpoint returned HTTP 503`
`run-05` 2026-10-07 20:23	commit not recorded	3	`AssertionError: Shipping endpoint returned HTTP 503`
`run-04` 2026-10-07 20:23	commit not recorded	2	`AssertionError: Shipping endpoint returned HTTP 503`

test_pricing_endpoint INTERMITTENT 25%

tests.test_service.test_pricing_endpoint

Final failure rate (95% CI)25% [8.9%–53%] · 3 of 12 runs

Usable outcomesruns: 12; skipped: 0; excluded: 0

Passed on retry0 (explicit failed attempts before a pass)

Retry exhaustion0 (every recorded attempt failed)

Flip rate36% of 11 usable consecutive pairs

Same-context rerun disagreementno commits with multiple runs observed

Flakiness score0.147

Activity3 failures in 2 separate stretches: too few to place.

Duration trend (without retries)-0.0 ms/history run

Timing observations (without retries)12

Duration × failure correlation-0.17

Failure rate by runnercontrolled-loopback-capture: 25% (n=12)

Failure rate by OSLinux: 25% (n=12)

Failure messages

AssertionError: Pricing endpoint returned HTTP 503 ×3

Failures, newest first

Run	Same commit, other runs	Other tests failed	Named in output, or message
`run-10` 2026-10-07 20:23	commit not recorded	2	`AssertionError: Pricing endpoint returned HTTP 503`
`run-05` 2026-10-07 20:23	commit not recorded	3	`AssertionError: Pricing endpoint returned HTTP 503`
`run-04` 2026-10-07 20:23	commit not recorded	2	`AssertionError: Pricing endpoint returned HTTP 503`

test_optional_endpoint INTERMITTENT 10%

tests.test_service.test_optional_endpoint

Final failure rate (95% CI)10% [1.8%–40%] · 1 of 10 runs

Usable outcomesruns: 10; skipped: 1; excluded: 0

Passed on retry0 (explicit failed attempts before a pass)

Retry exhaustion0 (every recorded attempt failed)

Flip rate22% of 9 usable consecutive pairs

Same-context rerun disagreementno commits with multiple runs observed

Flakiness score0.064

Activity1 failures: too few to place.

Duration trend (without retries)+0.0 ms/history run

Timing observations (without retries)10

Duration × failure correlation+0.67

Failure rate by runnercontrolled-loopback-capture: 10% (n=10)

Failure rate by OSLinux: 10% (n=10)

Failure messages

AssertionError: Optional endpoint returned HTTP 503 ×1

Failures, newest first

Run	Same commit, other runs	Other tests failed	Named in output, or message
`run-05` 2026-10-07 20:23	commit not recorded	3	`AssertionError: Optional endpoint returned HTTP 503`

test_independent_math INTERMITTENT 8.3%

tests.test_service.test_independent_math

Final failure rate (95% CI)8.3% [1.5%–35%] · 1 of 12 runs

Usable outcomesruns: 12; skipped: 0; excluded: 0

Passed on retry0 (explicit failed attempts before a pass)

Retry exhaustion0 (every recorded attempt failed)

Flip rate18% of 11 usable consecutive pairs

Same-context rerun disagreementno commits with multiple runs observed

Flakiness score0.064

Activity1 failures: too few to place.

Duration trend (without retries)+0.0 ms/history run

Timing observations (without retries)12

Failure rate by runnercontrolled-loopback-capture: 8% (n=12)

Failure rate by OSLinux: 8% (n=12)

Failure messages

assert 4 == 5 ×1

Failures, newest first

Run	Same commit, other runs	Other tests failed	Named in output, or message
`run-07` 2026-10-07 20:23	commit not recorded	none	`assert 4 == 5`

test_healthy_control 0%

tests.test_service.test_healthy_control

Final failure rate (95% CI)0% [0%–24%] · 0 of 12 runs

Usable outcomesruns: 12; skipped: 0; excluded: 0

Passed on retry0 (explicit failed attempts before a pass)

Retry exhaustion0 (every recorded attempt failed)

Flip rate0% of 11 usable consecutive pairs

Same-context rerun disagreementno commits with multiple runs observed

Flakiness score0.000

Duration trend (without retries)+0.0 ms/history run

Timing observations (without retries)12

Failure rate by runnercontrolled-loopback-capture: 0% (n=12)

Failure rate by OSLinux: 0% (n=12)

pass passed on retry fail error skip not run unknown / excluded Rates use the final outcome of each run; retry attempts do not increase the sample size. Rows sorted broken → new → flaky → quiet → insufficient data → healthy, then by score. Columns are runs in chronological order. Click a row for detail. Hover a cell for the run.