1broken
3flaky
8healthy
0insufficient data
0test-runs passed on retry
0test-runs excluded
Test × run heatmap
Tests under tests.test_suite
test_regression_after_commit DEFECT 32%
tests.test_suite.test_regression_after_commit
Final failure rate (95% CI)32% [26%–38%] · 70 of 222 runs
Usable outcomesruns: 222; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate0.45% of 221 usable consecutive pairs
Same-context rerun disagreement0/32 commit/branch/runner/OS groups; 0% of same-commit run pairs
Flakiness score0.128
Failures on a commit run again0 of 20 passed in another run of the same commit; 20 failed in every run of it; 50 more had no other run
Change point0% → 100% failure rate at run run-0152 (commit 00082aaaaaaa)
Duration trend (without retries)+0.0 ms/history run
Timing observations (without retries)222
Duration × failure correlation+0.10
Failure rate by runnermacos-latest: 32% (n=47), ubuntu-latest: 31% (n=175)
Failure rate by OSmacos: 32% (n=47), linux: 31% (n=175)
Failure messages
Failures, newest first
| Run | Same commit, other runs | Other tests failed | Named in output, or message |
|---|---|---|---|
run-02212026-06-04 09:27 | 000bdaaaaaaano other run | none | Failed: off-by-one regression introduced at commit 130 |
run-02202026-06-04 09:04 | 000bcaaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-02192026-06-04 08:41 | 000bbaaaaaaano other run | 2 | Failed: off-by-one regression introduced at commit 130 |
run-02182026-06-04 08:22 | 000baaaaaaaafailed in every run (2 of this commit) | 2 | Failed: off-by-one regression introduced at commit 130 |
run-02172026-06-04 08:18 | 000baaaaaaaafailed in every run (2 of this commit) | none | Failed: off-by-one regression introduced at commit 130 |
run-02162026-06-04 07:55 | 000b9aaaaaaano other run | none | Failed: off-by-one regression introduced at commit 130 |
run-02152026-06-04 07:32 | 000b8aaaaaaano other run | none | Failed: off-by-one regression introduced at commit 130 |
run-02142026-06-04 07:09 | 000b7aaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-02132026-06-04 06:46 | 000b6aaaaaaano other run | none | Failed: off-by-one regression introduced at commit 130 |
run-02122026-06-04 06:23 | 000b5aaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-02112026-06-04 06:04 | 000b4aaaaaaafailed in every run (2 of this commit) | none | Failed: off-by-one regression introduced at commit 130 |
run-02102026-06-04 06:00 | 000b4aaaaaaafailed in every run (2 of this commit) | none | Failed: off-by-one regression introduced at commit 130 |
run-02092026-06-04 05:37 | 000b3aaaaaaano other run | 2 | Failed: off-by-one regression introduced at commit 130 |
run-02082026-06-04 05:14 | 000b2aaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-02072026-06-04 04:51 | 000b1aaaaaaano other run | 2 | Failed: off-by-one regression introduced at commit 130 |
run-02062026-06-04 04:28 | 000b0aaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-02052026-06-04 04:05 | 000afaaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-02042026-06-04 03:46 | 000aeaaaaaaafailed in every run (2 of this commit) | 1 | Failed: off-by-one regression introduced at commit 130 |
run-02032026-06-04 03:42 | 000aeaaaaaaafailed in every run (2 of this commit) | none | Failed: off-by-one regression introduced at commit 130 |
run-02022026-06-04 03:19 | 000adaaaaaaano other run | none | Failed: off-by-one regression introduced at commit 130 |
run-02012026-06-04 02:56 | 000acaaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-02002026-06-04 02:33 | 000abaaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-01992026-06-04 02:10 | 000aaaaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-01982026-06-04 01:47 | 000a9aaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-01972026-06-04 01:28 | 000a8aaaaaaafailed in every run (2 of this commit) | none | Failed: off-by-one regression introduced at commit 130 |
run-01962026-06-04 01:24 | 000a8aaaaaaafailed in every run (2 of this commit) | 1 | Failed: off-by-one regression introduced at commit 130 |
run-01952026-06-04 01:01 | 000a7aaaaaaano other run | 2 | Failed: off-by-one regression introduced at commit 130 |
run-01942026-06-04 00:38 | 000a6aaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-01932026-06-04 00:15 | 000a5aaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-01922026-06-03 23:52 | 000a4aaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-01912026-06-03 23:29 | 000a3aaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-01902026-06-03 23:10 | 000a2aaaaaaafailed in every run (2 of this commit) | none | Failed: off-by-one regression introduced at commit 130 |
run-01892026-06-03 23:06 | 000a2aaaaaaafailed in every run (2 of this commit) | 2 | Failed: off-by-one regression introduced at commit 130 |
run-01882026-06-03 22:43 | 000a1aaaaaaano other run | 2 | Failed: off-by-one regression introduced at commit 130 |
run-01872026-06-03 22:20 | 000a0aaaaaaano other run | 2 | Failed: off-by-one regression introduced at commit 130 |
run-01862026-06-03 21:57 | 0009faaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-01852026-06-03 21:34 | 0009eaaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-01842026-06-03 21:11 | 0009daaaaaaano other run | 1 | Failed: off-by-one regression introduced at commit 130 |
run-01832026-06-03 20:52 | 0009caaaaaaafailed in every run (2 of this commit) | none | Failed: off-by-one regression introduced at commit 130 |
run-01822026-06-03 20:48 | 0009caaaaaaafailed in every run (2 of this commit) | 1 | Failed: off-by-one regression introduced at commit 130 |
Showing the latest 40 of 70 failures; --json has every one.
test_reads_cache_depends_on_order INTERMITTENT 48%
tests.test_suite.test_reads_cache_depends_on_order
Final failure rate (95% CI)48% [41%–54%] · 106 of 222 runs
Usable outcomesruns: 222; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate48% of 221 usable consecutive pairs
Same-context rerun disagreement19/32 commit/branch/runner/OS groups; 59% of same-commit run pairs
Flakiness score0.620
Failures on a commit run again19 of 27 passed in another run of the same commit; 8 failed in every run of it; 79 more had no other run
ActivityOngoing: 106 failures in 53 separate stretches; the longest quiet spell between failures was 6 runs, and the last failure was 1 runs ago.
Duration trend (without retries)-0.0 ms/history run
Timing observations (without retries)222
Duration × failure correlation+0.12
Failure rate by runnermacos-latest: 51% (n=47), ubuntu-latest: 47% (n=175)
Failure rate by OSmacos: 51% (n=47), linux: 47% (n=175)
Failure messages
Failures, newest first
| Run | Same commit, other runs | Other tests failed | Named in output, or message |
|---|---|---|---|
run-02202026-06-04 09:04 | 000bcaaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-02192026-06-04 08:41 | 000bbaaaaaaano other run | 2 | AssertionError: cache was not warmed before this test ran |
run-02182026-06-04 08:22 | 000baaaaaaaapassed in another run (2 of this commit) | 2 | AssertionError: cache was not warmed before this test ran |
run-02122026-06-04 06:23 | 000b5aaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-02092026-06-04 05:37 | 000b3aaaaaaano other run | 2 | AssertionError: cache was not warmed before this test ran |
run-02082026-06-04 05:14 | 000b2aaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-02072026-06-04 04:51 | 000b1aaaaaaano other run | 2 | AssertionError: cache was not warmed before this test ran |
run-02052026-06-04 04:05 | 000afaaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-02042026-06-04 03:46 | 000aeaaaaaaapassed in another run (2 of this commit) | 1 | AssertionError: cache was not warmed before this test ran |
run-02012026-06-04 02:56 | 000acaaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01982026-06-04 01:47 | 000a9aaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01922026-06-03 23:52 | 000a4aaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01892026-06-03 23:06 | 000a2aaaaaaapassed in another run (2 of this commit) | 2 | AssertionError: cache was not warmed before this test ran |
run-01882026-06-03 22:43 | 000a1aaaaaaano other run | 2 | AssertionError: cache was not warmed before this test ran |
run-01872026-06-03 22:20 | 000a0aaaaaaano other run | 2 | AssertionError: cache was not warmed before this test ran |
run-01852026-06-03 21:34 | 0009eaaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01842026-06-03 21:11 | 0009daaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01812026-06-03 20:25 | 0009baaaaaaano other run | 2 | AssertionError: cache was not warmed before this test ran |
run-01782026-06-03 19:16 | 00098aaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01772026-06-03 18:53 | 00097aaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01762026-06-03 18:34 | 00096aaaaaaapassed in another run (2 of this commit) | 1 | AssertionError: cache was not warmed before this test ran |
run-01732026-06-03 17:44 | 00094aaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01692026-06-03 16:16 | 00090aaaaaaapassed in another run (2 of this commit) | 1 | AssertionError: cache was not warmed before this test ran |
run-01672026-06-03 15:49 | 0008faaaaaaano other run | 2 | AssertionError: cache was not warmed before this test ran |
run-01652026-06-03 15:03 | 0008daaaaaaano other run | 2 | AssertionError: cache was not warmed before this test ran |
run-01602026-06-03 13:31 | 00089aaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01562026-06-03 11:59 | 00085aaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01552026-06-03 11:40 | 00084aaaaaaafailed in every run (2 of this commit) | 1 | AssertionError: cache was not warmed before this test ran |
run-01542026-06-03 11:36 | 00084aaaaaaafailed in every run (2 of this commit) | 1 | AssertionError: cache was not warmed before this test ran |
run-01532026-06-03 11:13 | 00083aaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01522026-06-03 10:50 | 00082aaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01512026-06-03 10:27 | 00081aaaaaaano other run | none | AssertionError: cache was not warmed before this test ran |
run-01502026-06-03 10:04 | 00080aaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01462026-06-03 08:55 | 0007daaaaaaano other run | none | AssertionError: cache was not warmed before this test ran |
run-01442026-06-03 08:09 | 0007baaaaaaano other run | 1 | AssertionError: cache was not warmed before this test ran |
run-01432026-06-03 07:46 | 0007aaaaaaaano other run | none | AssertionError: cache was not warmed before this test ran |
run-01422026-06-03 07:23 | 00079aaaaaaano other run | none | AssertionError: cache was not warmed before this test ran |
run-01412026-06-03 07:04 | 00078aaaaaaafailed in every run (2 of this commit) | 1 | AssertionError: cache was not warmed before this test ran |
run-01402026-06-03 07:00 | 00078aaaaaaafailed in every run (2 of this commit) | none | AssertionError: cache was not warmed before this test ran |
run-01392026-06-03 06:37 | 00077aaaaaaano other run | none | AssertionError: cache was not warmed before this test ran |
Showing the latest 40 of 106 failures; --json has every one.
test_tight_timeout_race INTERMITTENT 29%
tests.test_suite.test_tight_timeout_race
Final failure rate (95% CI)29% [24%–36%] · 65 of 222 runs
Usable outcomesruns: 222; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate44% of 221 usable consecutive pairs
Same-context rerun disagreement10/32 commit/branch/runner/OS groups; 31% of same-commit run pairs
Flakiness score0.419
Failures on a commit run again10 of 14 passed in another run of the same commit; 4 failed in every run of it; 51 more had no other run
ActivityOngoing: 65 failures in 49 separate stretches; the longest quiet spell between failures was 13 runs, and the last failure was 2 runs ago.
Duration trend (without retries)+0.0 ms/history run
Timing observations (without retries)222
Duration × failure correlation+0.79
Failure rate by runnermacos-latest: 51% (n=47), ubuntu-latest: 23% (n=175)
Failure rate by OSmacos: 51% (n=47), linux: 23% (n=175)
Failure messages
Failures, newest first
| Run | Same commit, other runs | Other tests failed | Named in output, or message |
|---|---|---|---|
run-02192026-06-04 08:41 | 000bbaaaaaaano other run | 2 | AssertionError: took 0.0172s, budget 0.0125s |
run-02182026-06-04 08:22 | 000baaaaaaaapassed in another run (2 of this commit) | 2 | AssertionError: took 0.0135s, budget 0.0125s |
run-02142026-06-04 07:09 | 000b7aaaaaaano other run | 1 | AssertionError: took 0.0136s, budget 0.0125s |
run-02002026-06-04 02:33 | 000abaaaaaaano other run | 1 | AssertionError: took 0.0173s, budget 0.0125s |
run-01962026-06-04 01:24 | 000a8aaaaaaapassed in another run (2 of this commit) | 1 | AssertionError: took 0.0137s, budget 0.0125s |
run-01952026-06-04 01:01 | 000a7aaaaaaano other run | 2 | AssertionError: took 0.0134s, budget 0.0125s |
run-01942026-06-04 00:38 | 000a6aaaaaaano other run | 1 | AssertionError: took 0.0143s, budget 0.0125s |
run-01932026-06-04 00:15 | 000a5aaaaaaano other run | 1 | AssertionError: took 0.0126s, budget 0.0125s |
run-01912026-06-03 23:29 | 000a3aaaaaaano other run | 1 | AssertionError: took 0.0145s, budget 0.0125s |
run-01882026-06-03 22:43 | 000a1aaaaaaano other run | 2 | AssertionError: took 0.0139s, budget 0.0125s |
run-01872026-06-03 22:20 | 000a0aaaaaaano other run | 2 | AssertionError: took 0.0136s, budget 0.0125s |
run-01862026-06-03 21:57 | 0009faaaaaaano other run | 1 | AssertionError: took 0.0151s, budget 0.0125s |
run-01812026-06-03 20:25 | 0009baaaaaaano other run | 2 | AssertionError: took 0.0130s, budget 0.0125s |
run-01792026-06-03 19:39 | 00099aaaaaaano other run | 1 | AssertionError: took 0.0127s, budget 0.0125s |
run-01672026-06-03 15:49 | 0008faaaaaaano other run | 2 | AssertionError: took 0.0164s, budget 0.0125s |
run-01662026-06-03 15:26 | 0008eaaaaaaano other run | 1 | AssertionError: took 0.0149s, budget 0.0125s |
run-01652026-06-03 15:03 | 0008daaaaaaano other run | 2 | AssertionError: took 0.0135s, budget 0.0125s |
run-01642026-06-03 14:40 | 0008caaaaaaano other run | 1 | AssertionError: took 0.0143s, budget 0.0125s |
run-01632026-06-03 14:17 | 0008baaaaaaano other run | 1 | AssertionError: took 0.0165s, budget 0.0125s |
run-01612026-06-03 13:54 | 0008aaaaaaaapassed in another run (2 of this commit) | 2 | AssertionError: took 0.0135s, budget 0.0125s |
run-01582026-06-03 12:45 | 00087aaaaaaano other run | 1 | AssertionError: took 0.0169s, budget 0.0125s |
run-01492026-06-03 09:41 | 0007faaaaaaano other run | none | AssertionError: took 0.0138s, budget 0.0125s |
run-01442026-06-03 08:09 | 0007baaaaaaano other run | 1 | AssertionError: took 0.0171s, budget 0.0125s |
run-01412026-06-03 07:04 | 00078aaaaaaapassed in another run (2 of this commit) | 1 | AssertionError: took 0.0138s, budget 0.0125s |
run-01372026-06-03 05:51 | 00075aaaaaaano other run | none | AssertionError: took 0.0141s, budget 0.0125s |
run-01352026-06-03 05:05 | 00073aaaaaaano other run | none | AssertionError: took 0.0151s, budget 0.0125s |
run-01312026-06-03 03:56 | 00070aaaaaaano other run | 1 | AssertionError: took 0.0129s, budget 0.0125s |
run-01292026-06-03 03:10 | 0006eaaaaaaano other run | 1 | AssertionError: took 0.0139s, budget 0.0125s |
run-01252026-06-03 02:01 | 0006baaaaaaano other run | 2 | AssertionError: took 0.0163s, budget 0.0125s |
run-01232026-06-03 01:15 | 00069aaaaaaano other run | 1 | AssertionError: took 0.0147s, budget 0.0125s |
run-01162026-06-02 22:57 | 00063aaaaaaano other run | none | AssertionError: took 0.0164s, budget 0.0125s |
run-01152026-06-02 22:34 | 00062aaaaaaano other run | none | AssertionError: took 0.0128s, budget 0.0125s |
run-01122026-06-02 21:48 | 00060aaaaaaapassed in another run (2 of this commit) | none | AssertionError: took 0.0143s, budget 0.0125s |
run-01102026-06-02 21:02 | 0005eaaaaaaano other run | 1 | AssertionError: took 0.0134s, budget 0.0125s |
run-01042026-06-02 19:07 | 00059aaaaaaano other run | none | AssertionError: took 0.0146s, budget 0.0125s |
run-01032026-06-02 18:44 | 00058aaaaaaano other run | 2 | AssertionError: took 0.0146s, budget 0.0125s |
run-01012026-06-02 17:58 | 00056aaaaaaano other run | none | AssertionError: took 0.0145s, budget 0.0125s |
run-00992026-06-02 17:16 | 00054aaaaaaafailed in every run (2 of this commit) | none | AssertionError: took 0.0142s, budget 0.0125s |
run-00982026-06-02 17:12 | 00054aaaaaaafailed in every run (2 of this commit) | 1 | AssertionError: took 0.0127s, budget 0.0125s |
run-00972026-06-02 16:49 | 00053aaaaaaano other run | 1 | AssertionError: took 0.0171s, budget 0.0125s |
Showing the latest 40 of 65 failures; --json has every one.
test_probabilistic_threshold INTERMITTENT 12%
tests.test_suite.test_probabilistic_threshold
Final failure rate (95% CI)12% [8.1%–17%] · 26 of 222 runs
Usable outcomesruns: 222; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate20% of 221 usable consecutive pairs
Same-context rerun disagreement8/32 commit/branch/runner/OS groups; 25% of same-commit run pairs
Flakiness score0.226
Failures on a commit run again8 of 8 passed in another run of the same commit; 0 failed in every run of it; 18 more had no other run
ActivityOngoing: 26 failures in 22 separate stretches; the longest quiet spell between failures was 26 runs, and the last failure was 12 runs ago.
Duration trend (without retries)-0.0 ms/history run
Timing observations (without retries)222
Duration × failure correlation+0.18
Failure rate by runnerubuntu-latest: 13% (n=175), macos-latest: 9% (n=47)
Failure rate by OSlinux: 13% (n=175), macos: 9% (n=47)
Failure messages
Failures, newest first
| Run | Same commit, other runs | Other tests failed | Named in output, or message |
|---|---|---|---|
run-02092026-06-04 05:37 | 000b3aaaaaaano other run | 2 | assert 0.09628953034368859 >= 0.12 |
run-02072026-06-04 04:51 | 000b1aaaaaaano other run | 2 | assert 0.08941430936329631 >= 0.12 |
run-02062026-06-04 04:28 | 000b0aaaaaaano other run | 1 | assert 0.08081693476273633 >= 0.12 |
run-01992026-06-04 02:10 | 000aaaaaaaaano other run | 1 | assert 0.059334657339586094 >= 0.12 |
run-01952026-06-04 01:01 | 000a7aaaaaaano other run | 2 | assert 0.04030508274093669 >= 0.12 |
run-01892026-06-03 23:06 | 000a2aaaaaaapassed in another run (2 of this commit) | 2 | assert 0.004820276563887282 >= 0.12 |
run-01822026-06-03 20:48 | 0009caaaaaaapassed in another run (2 of this commit) | 1 | assert 0.0218900605841974 >= 0.12 |
run-01612026-06-03 13:54 | 0008aaaaaaaapassed in another run (2 of this commit) | 2 | assert 0.0032748591168019203 >= 0.12 |
run-01502026-06-03 10:04 | 00080aaaaaaano other run | 1 | assert 0.07920716825148089 >= 0.12 |
run-01362026-06-03 05:28 | 00074aaaaaaano other run | 1 | assert 0.06018069615248589 >= 0.12 |
run-01282026-06-03 02:47 | 0006daaaaaaano other run | none | assert 0.05721115103909846 >= 0.12 |
run-01272026-06-03 02:28 | 0006caaaaaaapassed in another run (2 of this commit) | 1 | assert 0.017483327202417298 >= 0.12 |
run-01252026-06-03 02:01 | 0006baaaaaaano other run | 2 | assert 0.1168758847939757 >= 0.12 |
run-01222026-06-03 00:52 | 00068aaaaaaano other run | 1 | assert 0.03458134024717596 >= 0.12 |
run-01082026-06-02 20:16 | 0005caaaaaaano other run | 1 | assert 0.11079116543174072 >= 0.12 |
run-01032026-06-02 18:44 | 00058aaaaaaano other run | 2 | assert 0.037473673152819575 >= 0.12 |
run-00942026-06-02 15:40 | 00050aaaaaaano other run | 1 | assert 0.00829278517704446 >= 0.12 |
run-00932026-06-02 15:17 | 0004faaaaaaano other run | 1 | assert 0.046548433760871144 >= 0.12 |
run-00822026-06-02 11:50 | 00046aaaaaaano other run | 2 | assert 0.092278873783887 >= 0.12 |
run-00812026-06-02 11:27 | 00045aaaaaaano other run | none | assert 0.020546099121637074 >= 0.12 |
run-00762026-06-02 09:55 | 00041aaaaaaano other run | none | assert 0.026162612990571654 >= 0.12 |
run-00492026-06-02 01:06 | 0002aaaaaaaapassed in another run (2 of this commit) | 1 | assert 0.08687220296726883 >= 0.12 |
run-00422026-06-01 22:48 | 00024aaaaaaapassed in another run (2 of this commit) | none | assert 0.004752672418996462 >= 0.12 |
run-00362026-06-01 20:34 | 0001eaaaaaaapassed in another run (2 of this commit) | 1 | assert 0.051352199550979916 >= 0.12 |
run-00112026-06-01 12:27 | 00009aaaaaaano other run | none | assert 0.04874040894208831 >= 0.12 |
run-00082026-06-01 11:22 | 00006aaaaaaapassed in another run (2 of this commit) | none | assert 0.10490622573466313 >= 0.12 |
test_sleep_a_bit 0%
tests.test_suite.test_sleep_a_bit
Final failure rate (95% CI)0% [0%–1.7%] · 0 of 222 runs
Usable outcomesruns: 222; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate0% of 221 usable consecutive pairs
Same-context rerun disagreement0/32 commit/branch/runner/OS groups; 0% of same-commit run pairs
Flakiness score0.000
Duration trend (without retries)+0.0 ms/history run
Timing observations (without retries)222
Failure rate by runnermacos-latest: 0% (n=47), ubuntu-latest: 0% (n=175)
Failure rate by OSlinux: 0% (n=175), macos: 0% (n=47)
test_string_formatting 0%
tests.test_suite.test_string_formatting
Final failure rate (95% CI)0% [0%–1.7%] · 0 of 222 runs
Usable outcomesruns: 222; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate0% of 221 usable consecutive pairs
Same-context rerun disagreement0/32 commit/branch/runner/OS groups; 0% of same-commit run pairs
Flakiness score0.000
Duration trend (without retries)+0.0 ms/history run
Timing observations (without retries)222
Failure rate by runnermacos-latest: 0% (n=47), ubuntu-latest: 0% (n=175)
Failure rate by OSlinux: 0% (n=175), macos: 0% (n=47)
test_list_comprehension 0%
tests.test_suite.test_list_comprehension
Final failure rate (95% CI)0% [0%–1.7%] · 0 of 222 runs
Usable outcomesruns: 222; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate0% of 221 usable consecutive pairs
Same-context rerun disagreement0/32 commit/branch/runner/OS groups; 0% of same-commit run pairs
Flakiness score0.000
Duration trend (without retries)+0.0 ms/history run
Timing observations (without retries)222
Failure rate by runnermacos-latest: 0% (n=47), ubuntu-latest: 0% (n=175)
Failure rate by OSlinux: 0% (n=175), macos: 0% (n=47)
test_string_split 0%
tests.test_suite.test_string_split
Final failure rate (95% CI)0% [0%–1.7%] · 0 of 222 runs
Usable outcomesruns: 222; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate0% of 221 usable consecutive pairs
Same-context rerun disagreement0/32 commit/branch/runner/OS groups; 0% of same-commit run pairs
Flakiness score0.000
Duration trend (without retries)-0.0 ms/history run
Timing observations (without retries)222
Failure rate by runnermacos-latest: 0% (n=47), ubuntu-latest: 0% (n=175)
Failure rate by OSlinux: 0% (n=175), macos: 0% (n=47)
test_populate_cache_first 0%
tests.test_suite.test_populate_cache_first
Final failure rate (95% CI)0% [0%–1.7%] · 0 of 222 runs
Usable outcomesruns: 222; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate0% of 221 usable consecutive pairs
Same-context rerun disagreement0/32 commit/branch/runner/OS groups; 0% of same-commit run pairs
Flakiness score0.000
Duration trend (without retries)+0.0 ms/history run
Timing observations (without retries)222
Failure rate by runnermacos-latest: 0% (n=47), ubuntu-latest: 0% (n=175)
Failure rate by OSlinux: 0% (n=175), macos: 0% (n=47)
test_dict_merge 0%
tests.test_suite.test_dict_merge
Final failure rate (95% CI)0% [0%–1.7%] · 0 of 222 runs
Usable outcomesruns: 222; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate0% of 221 usable consecutive pairs
Same-context rerun disagreement0/32 commit/branch/runner/OS groups; 0% of same-commit run pairs
Flakiness score0.000
Duration trend (without retries)+0.0 ms/history run
Timing observations (without retries)222
Failure rate by runnermacos-latest: 0% (n=47), ubuntu-latest: 0% (n=175)
Failure rate by OSlinux: 0% (n=175), macos: 0% (n=47)
test_sorted_is_stable 0%
tests.test_suite.test_sorted_is_stable
Final failure rate (95% CI)0% [0%–1.7%] · 0 of 222 runs
Usable outcomesruns: 222; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate0% of 221 usable consecutive pairs
Same-context rerun disagreement0/32 commit/branch/runner/OS groups; 0% of same-commit run pairs
Flakiness score0.000
Duration trend (without retries)+0.0 ms/history run
Timing observations (without retries)222
Failure rate by runnermacos-latest: 0% (n=47), ubuntu-latest: 0% (n=175)
Failure rate by OSlinux: 0% (n=175), macos: 0% (n=47)
test_addition 0%
tests.test_suite.test_addition
Final failure rate (95% CI)0% [0%–1.7%] · 0 of 222 runs
Usable outcomesruns: 222; skipped: 0; excluded: 0
Passed on retry0 (explicit failed attempts before a pass)
Retry exhaustion0 (every recorded attempt failed)
Flip rate0% of 221 usable consecutive pairs
Same-context rerun disagreement0/32 commit/branch/runner/OS groups; 0% of same-commit run pairs
Flakiness score0.000
Duration trend (without retries)+0.0 ms/history run
Timing observations (without retries)222
Failure rate by runnermacos-latest: 0% (n=47), ubuntu-latest: 0% (n=175)
Failure rate by OSlinux: 0% (n=175), macos: 0% (n=47)
pass
passed on retry
fail
error
skip
not run
unknown / excluded
Rates use the final outcome of each run; retry attempts do not increase the sample size.
Rows sorted broken → new → flaky → quiet → insufficient data → healthy, then by score. Columns are runs in chronological order. Click a row for detail. Hover a cell for the run.