Bug 305514
| Summary: | [GTK][WPE] Report of flaky tests on 14th Jan 2026 | ||
|---|---|---|---|
| Product: | WebKit | Reporter: | Carlos Alberto Lopez Perez <clopez> |
| Component: | WPE WebKit | Assignee: | Lauro Moura <lmoura> |
| Status: | NEW | ||
| Severity: | Normal | CC: | bugs-noreply, lmoura |
| Priority: | P2 | ||
| Version: | WebKit Nightly Build | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| See Also: |
https://bugs.webkit.org/show_bug.cgi?id=305509 https://bugs.webkit.org/show_bug.cgi?id=305502 https://bugs.webkit.org/show_bug.cgi?id=305503 |
||
Carlos Alberto Lopez Perez
The following tests have been identified as flaky both for platform GTK and WPE on 14th Jan 2026
compositing/patterns/direct-pattern-compositing-change.html [ ImageOnlyFailure Pass ]
compositing/patterns/direct-pattern-compositing-load.html [ ImageOnlyFailure Pass ]
fast/backgrounds/obscured-background-child-style-change.html [ ImageOnlyFailure Pass ]
fast/images/imagebitmap-memory.html [ ImageOnlyFailure Pass ]
fullscreen/fullscreen-enter-bottom-padding-animation.html [ Failure Pass ]
http/tests/security/offscreen-canvas-remote-read-remote-image.html [ Failure Pass ]
http/tests/storageAccess/request-and-grant-access-then-detach-should-not-have-access.https.html [ Failure Pass ]
http/tests/storageAccess/request-and-grant-access-then-navigate-cross-site-should-not-have-access.https.html [ Failure Pass ]
http/tests/storageAccess/request-and-grant-access-then-navigate-same-site-should-have-access.https.html [ Failure Pass ]
http/wpt/mediarecorder/MediaRecorder-audio-bitrate-mp4-opus.html [ Failure Pass ]
http/wpt/mediarecorder/MediaRecorder-audio-samplingrate-change.html [ Failure Pass ]
http/wpt/mediastream/getDisplayMedia-deviceid-persistency.html [ Failure Pass ]
http/wpt/service-workers/form-data-upload.html [ Failure Pass ]
imported/w3c/web-platform-tests/css/css-anchor-position/position-area-overflow-icb-002.html [ ImageOnlyFailure Pass ]
imported/w3c/web-platform-tests/css/css-view-transitions/transform-origin-view-transition-group.html [ ImageOnlyFailure Pass ]
imported/w3c/web-platform-tests/fullscreen/rendering/fullscreen-pseudo-class.html [ Failure Pass ]
imported/w3c/web-platform-tests/fullscreen/rendering/fullscreen-root-block-scroll.html [ Failure Pass ]
imported/w3c/web-platform-tests/fullscreen/rendering/ua-style-iframe.html [ Failure Pass ]
imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/media_fragment_seek.html [ Failure Pass ]
imported/w3c/web-platform-tests/service-workers/service-worker/fetch-request-redirect.https.html [ Failure Pass ]
imported/w3c/web-platform-tests/service-workers/service-worker/skip-waiting-installed.https.html [ Failure Pass ]
imported/w3c/web-platform-tests/webstorage/event_case_sensitive.html [ Failure Pass ]
webanimations/focus-accelerated-animated-element-initially-in-overflow.html [ Failure Pass ]
webgl/1.0.x/conformance/textures/misc/video-rotation.html [ Failure Pass ]
webgl/2.0.y/conformance/textures/misc/video-rotation.html [ Failure Pass ]
This is the flaky report for both ports
-------------------- compositing/patterns/direct-pattern-compositing-change.html --------------------
The bot gtk-release completed 902 runs on the interval [301594@main-305588@main]
Frecuency of results for test: compositing/patterns/direct-pattern-compositing-change.html
847 times [93.9%] -> NOERROR
16 times [1.8%] -> IMAGE
39 times [4.3%] -> IMAGE PASS
Of those 902 runs it didn't match the expectation 55 times [6.1%]
Details of the type and frequency of unmatched expectations:
16 times [1.8%] -> IMAGE (Expected: PASS)
39 times [4.3%] -> IMAGE PASS (Expected: PASS)
Flakiness factor: 10.5%
- This test was flaky on 10.5% of the 902 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 1018 runs on the interval [301599@main-305599@main]
Frecuency of results for test: compositing/patterns/direct-pattern-compositing-change.html
437 times [42.9%] -> NOERROR
280 times [27.5%] -> IMAGE
300 times [29.5%] -> IMAGE PASS
1 times [0.1%] -> TIMEOUT
Of those 1018 runs it didn't match the expectation 581 times [57.1%]
Details of the type and frequency of unmatched expectations:
280 times [27.5%] -> IMAGE (Expected: PASS)
300 times [29.5%] -> IMAGE PASS (Expected: PASS)
1 times [0.1%] -> TIMEOUT (Expected: PASS)
Flakiness factor: 64.9%
- This test was flaky on 64.9% of the 1018 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- compositing/patterns/direct-pattern-compositing-load.html --------------------
The bot gtk-release completed 898 runs on the interval [301594@main-305588@main]
Frecuency of results for test: compositing/patterns/direct-pattern-compositing-load.html
795 times [88.5%] -> NOERROR
16 times [1.8%] -> IMAGE
87 times [9.7%] -> IMAGE PASS
Of those 898 runs it didn't match the expectation 103 times [11.5%]
Details of the type and frequency of unmatched expectations:
16 times [1.8%] -> IMAGE (Expected: PASS)
87 times [9.7%] -> IMAGE PASS (Expected: PASS)
Flakiness factor: 20.9%
- This test was flaky on 20.9% of the 898 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 1013 runs on the interval [301599@main-305599@main]
Frecuency of results for test: compositing/patterns/direct-pattern-compositing-load.html
292 times [28.8%] -> IMAGE PASS
493 times [48.7%] -> NOERROR
228 times [22.5%] -> IMAGE
Of those 1013 runs it didn't match the expectation 520 times [51.3%]
Details of the type and frequency of unmatched expectations:
292 times [28.8%] -> IMAGE PASS (Expected: PASS)
228 times [22.5%] -> IMAGE (Expected: PASS)
Flakiness factor: 64.2%
- This test was flaky on 64.2% of the 1013 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- fast/backgrounds/obscured-background-child-style-change.html --------------------
The bot gtk-release completed 905 runs on the interval [301594@main-305588@main]
Frecuency of results for test: fast/backgrounds/obscured-background-child-style-change.html
107 times [11.8%] -> IMAGE PASS
773 times [85.4%] -> NOERROR
24 times [2.7%] -> IMAGE
1 times [0.1%] -> TIMEOUT PASS
Of those 905 runs it didn't match the expectation 132 times [14.6%]
Details of the type and frequency of unmatched expectations:
107 times [11.8%] -> IMAGE PASS (Expected: PASS)
24 times [2.7%] -> IMAGE (Expected: PASS)
1 times [0.1%] -> TIMEOUT PASS (Expected: PASS)
Flakiness factor: 25.1%
- This test was flaky on 25.1% of the 905 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 995 runs on the interval [301599@main-305599@main]
Frecuency of results for test: fast/backgrounds/obscured-background-child-style-change.html
563 times [56.6%] -> NOERROR
206 times [20.7%] -> IMAGE PASS
220 times [22.1%] -> IMAGE
6 times [0.6%] -> TIMEOUT
Of those 995 runs it didn't match the expectation 432 times [43.4%]
Details of the type and frequency of unmatched expectations:
206 times [20.7%] -> IMAGE PASS (Expected: PASS)
220 times [22.1%] -> IMAGE (Expected: PASS)
6 times [0.6%] -> TIMEOUT (Expected: PASS)
Flakiness factor: 57.9%
- This test was flaky on 57.9% of the 995 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- fast/images/imagebitmap-memory.html --------------------
The bot gtk-release completed 944 runs on the interval [301594@main-305588@main]
Frecuency of results for test: fast/images/imagebitmap-memory.html
458 times [48.5%] -> NOERROR
300 times [31.8%] -> IMAGE
182 times [19.3%] -> IMAGE PASS
2 times [0.2%] -> TIMEOUT IMAGE
2 times [0.2%] -> TIMEOUT
Of those 944 runs it didn't match the expectation 486 times [51.5%]
Details of the type and frequency of unmatched expectations:
300 times [31.8%] -> IMAGE (Expected: PASS)
182 times [19.3%] -> IMAGE PASS (Expected: PASS)
2 times [0.2%] -> TIMEOUT IMAGE (Expected: PASS)
2 times [0.2%] -> TIMEOUT (Expected: PASS)
Flakiness factor: 62.8%
- This test was flaky on 62.8% of the 944 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 999 runs on the interval [301599@main-305599@main]
Frecuency of results for test: fast/images/imagebitmap-memory.html
506 times [50.7%] -> NOERROR
164 times [16.4%] -> IMAGE PASS
329 times [32.9%] -> IMAGE
Of those 999 runs it didn't match the expectation 493 times [49.3%]
Details of the type and frequency of unmatched expectations:
164 times [16.4%] -> IMAGE PASS (Expected: PASS)
329 times [32.9%] -> IMAGE (Expected: PASS)
Flakiness factor: 59.0%
- This test was flaky on 59.0% of the 999 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- fullscreen/fullscreen-enter-bottom-padding-animation.html --------------------
The bot gtk-release completed 950 runs on the interval [301594@main-305588@main]
Frecuency of results for test: fullscreen/fullscreen-enter-bottom-padding-animation.html
458 times [48.2%] -> NOERROR
212 times [22.3%] -> TEXT
280 times [29.5%] -> TEXT PASS
Of those 950 runs it didn't match the expectation 492 times [51.8%]
Details of the type and frequency of unmatched expectations:
212 times [22.3%] -> TEXT (Expected: PASS)
280 times [29.5%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 67.6%
- This test was flaky on 67.6% of the 950 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 1026 runs on the interval [301599@main-305599@main]
Frecuency of results for test: fullscreen/fullscreen-enter-bottom-padding-animation.html
363 times [35.4%] -> NOERROR
500 times [48.7%] -> TEXT
163 times [15.9%] -> TEXT PASS
Of those 1026 runs it didn't match the expectation 663 times [64.6%]
Details of the type and frequency of unmatched expectations:
500 times [48.7%] -> TEXT (Expected: PASS)
163 times [15.9%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 58.3%
- This test was flaky on 58.3% of the 1026 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- http/tests/security/offscreen-canvas-remote-read-remote-image.html --------------------
The bot gtk-release completed 888 runs on the interval [301594@main-305588@main]
Frecuency of results for test: http/tests/security/offscreen-canvas-remote-read-remote-image.html
862 times [97.1%] -> NOERROR
24 times [2.7%] -> TEXT PASS
2 times [0.2%] -> TEXT
Of those 888 runs it didn't match the expectation 26 times [2.9%]
Details of the type and frequency of unmatched expectations:
24 times [2.7%] -> TEXT PASS (Expected: PASS)
2 times [0.2%] -> TEXT (Expected: PASS)
Flakiness factor: 5.0%
- This test was flaky on 5.0% of the 888 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 996 runs on the interval [301599@main-305599@main]
Frecuency of results for test: http/tests/security/offscreen-canvas-remote-read-remote-image.html
403 times [40.5%] -> NOERROR
301 times [30.2%] -> TEXT PASS
291 times [29.2%] -> TEXT
1 times [0.1%] -> TEXT CRASH
Of those 996 runs it didn't match the expectation 593 times [59.5%]
Details of the type and frequency of unmatched expectations:
301 times [30.2%] -> TEXT PASS (Expected: PASS)
291 times [29.2%] -> TEXT (Expected: PASS)
1 times [0.1%] -> TEXT CRASH (Expected: PASS)
Flakiness factor: 50.3%
- This test was flaky on 50.3% of the 996 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- http/tests/storageAccess/request-and-grant-access-then-detach-should-not-have-access.https.html --------------------
The bot gtk-release completed 913 runs on the interval [301594@main-305588@main]
Frecuency of results for test: http/tests/storageAccess/request-and-grant-access-then-detach-should-not-have-access.https.html
572 times [62.7%] -> NOERROR
190 times [20.8%] -> TEXT
151 times [16.5%] -> TEXT PASS
Of those 913 runs it didn't match the expectation 341 times [37.3%]
Details of the type and frequency of unmatched expectations:
190 times [20.8%] -> TEXT (Expected: PASS)
151 times [16.5%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 56.6%
- This test was flaky on 56.6% of the 913 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 950 runs on the interval [301599@main-305599@main]
Frecuency of results for test: http/tests/storageAccess/request-and-grant-access-then-detach-should-not-have-access.https.html
692 times [72.8%] -> NOERROR
169 times [17.8%] -> TEXT PASS
88 times [9.3%] -> TEXT
1 times [0.1%] -> TIMEOUT
Of those 950 runs it didn't match the expectation 258 times [27.2%]
Details of the type and frequency of unmatched expectations:
169 times [17.8%] -> TEXT PASS (Expected: PASS)
88 times [9.3%] -> TEXT (Expected: PASS)
1 times [0.1%] -> TIMEOUT (Expected: PASS)
Flakiness factor: 42.7%
- This test was flaky on 42.7% of the 950 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- http/tests/storageAccess/request-and-grant-access-then-navigate-cross-site-should-not-have-access.https.html --------------------
The bot gtk-release completed 919 runs on the interval [301594@main-305588@main]
Frecuency of results for test: http/tests/storageAccess/request-and-grant-access-then-navigate-cross-site-should-not-have-access.https.html
605 times [65.8%] -> NOERROR
171 times [18.6%] -> TEXT
143 times [15.6%] -> TEXT PASS
Of those 919 runs it didn't match the expectation 314 times [34.2%]
Details of the type and frequency of unmatched expectations:
171 times [18.6%] -> TEXT (Expected: PASS)
143 times [15.6%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 50.5%
- This test was flaky on 50.5% of the 919 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 953 runs on the interval [301599@main-305599@main]
Frecuency of results for test: http/tests/storageAccess/request-and-grant-access-then-navigate-cross-site-should-not-have-access.https.html
688 times [72.2%] -> NOERROR
95 times [10.0%] -> TEXT
169 times [17.7%] -> TEXT PASS
1 times [0.1%] -> TIMEOUT
Of those 953 runs it didn't match the expectation 265 times [27.8%]
Details of the type and frequency of unmatched expectations:
95 times [10.0%] -> TEXT (Expected: PASS)
169 times [17.7%] -> TEXT PASS (Expected: PASS)
1 times [0.1%] -> TIMEOUT (Expected: PASS)
Flakiness factor: 42.9%
- This test was flaky on 42.9% of the 953 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- http/tests/storageAccess/request-and-grant-access-then-navigate-same-site-should-have-access.https.html --------------------
The bot gtk-release completed 921 runs on the interval [301594@main-305588@main]
Frecuency of results for test: http/tests/storageAccess/request-and-grant-access-then-navigate-same-site-should-have-access.https.html
499 times [54.2%] -> NOERROR
251 times [27.3%] -> TEXT
171 times [18.6%] -> TEXT PASS
Of those 921 runs it didn't match the expectation 422 times [45.8%]
Details of the type and frequency of unmatched expectations:
251 times [27.3%] -> TEXT (Expected: PASS)
171 times [18.6%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 59.4%
- This test was flaky on 59.4% of the 921 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 943 runs on the interval [301599@main-305599@main]
Frecuency of results for test: http/tests/storageAccess/request-and-grant-access-then-navigate-same-site-should-have-access.https.html
647 times [68.6%] -> NOERROR
194 times [20.6%] -> TEXT PASS
101 times [10.7%] -> TEXT
1 times [0.1%] -> TIMEOUT
Of those 943 runs it didn't match the expectation 296 times [31.4%]
Details of the type and frequency of unmatched expectations:
194 times [20.6%] -> TEXT PASS (Expected: PASS)
101 times [10.7%] -> TEXT (Expected: PASS)
1 times [0.1%] -> TIMEOUT (Expected: PASS)
Flakiness factor: 49.7%
- This test was flaky on 49.7% of the 943 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- http/wpt/mediarecorder/MediaRecorder-audio-bitrate-mp4-opus.html --------------------
The bot gtk-release completed 891 runs on the interval [301594@main-305588@main]
Frecuency of results for test: http/wpt/mediarecorder/MediaRecorder-audio-bitrate-mp4-opus.html
741 times [83.2%] -> NOERROR
54 times [6.1%] -> TEXT
96 times [10.8%] -> TEXT PASS
Of those 891 runs it didn't match the expectation 150 times [16.8%]
Details of the type and frequency of unmatched expectations:
54 times [6.1%] -> TEXT (Expected: PASS)
96 times [10.8%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 27.2%
- This test was flaky on 27.2% of the 891 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 906 runs on the interval [301599@main-305599@main]
Frecuency of results for test: http/wpt/mediarecorder/MediaRecorder-audio-bitrate-mp4-opus.html
730 times [80.6%] -> NOERROR
74 times [8.2%] -> TEXT
102 times [11.3%] -> TEXT PASS
Of those 906 runs it didn't match the expectation 176 times [19.4%]
Details of the type and frequency of unmatched expectations:
74 times [8.2%] -> TEXT (Expected: PASS)
102 times [11.3%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 28.6%
- This test was flaky on 28.6% of the 906 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- http/wpt/mediarecorder/MediaRecorder-audio-samplingrate-change.html --------------------
The bot gtk-release completed 945 runs on the interval [301594@main-305588@main]
Frecuency of results for test: http/wpt/mediarecorder/MediaRecorder-audio-samplingrate-change.html
386 times [40.8%] -> NOERROR
357 times [37.8%] -> TEXT
202 times [21.4%] -> TEXT PASS
Of those 945 runs it didn't match the expectation 559 times [59.2%]
Details of the type and frequency of unmatched expectations:
357 times [37.8%] -> TEXT (Expected: PASS)
202 times [21.4%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 54.5%
- This test was flaky on 54.5% of the 945 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 975 runs on the interval [301599@main-305599@main]
Frecuency of results for test: http/wpt/mediarecorder/MediaRecorder-audio-samplingrate-change.html
388 times [39.8%] -> NOERROR
386 times [39.6%] -> TEXT
200 times [20.5%] -> TEXT PASS
1 times [0.1%] -> TEXT CRASH
Of those 975 runs it didn't match the expectation 587 times [60.2%]
Details of the type and frequency of unmatched expectations:
386 times [39.6%] -> TEXT (Expected: PASS)
200 times [20.5%] -> TEXT PASS (Expected: PASS)
1 times [0.1%] -> TEXT CRASH (Expected: PASS)
Flakiness factor: 54.9%
- This test was flaky on 54.9% of the 975 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- http/wpt/mediastream/getDisplayMedia-deviceid-persistency.html --------------------
The bot gtk-release completed 958 runs on the interval [301594@main-305588@main]
Frecuency of results for test: http/wpt/mediastream/getDisplayMedia-deviceid-persistency.html
398 times [41.5%] -> NOERROR
265 times [27.7%] -> TEXT
295 times [30.8%] -> TEXT PASS
Of those 958 runs it didn't match the expectation 560 times [58.5%]
Details of the type and frequency of unmatched expectations:
265 times [27.7%] -> TEXT (Expected: PASS)
295 times [30.8%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 68.7%
- This test was flaky on 68.7% of the 958 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 1043 runs on the interval [301599@main-305599@main]
Frecuency of results for test: http/wpt/mediastream/getDisplayMedia-deviceid-persistency.html
438 times [42.0%] -> TEXT PASS
341 times [32.7%] -> NOERROR
264 times [25.3%] -> TEXT
Of those 1043 runs it didn't match the expectation 702 times [67.3%]
Details of the type and frequency of unmatched expectations:
438 times [42.0%] -> TEXT PASS (Expected: PASS)
264 times [25.3%] -> TEXT (Expected: PASS)
Flakiness factor: 74.0%
- This test was flaky on 74.0% of the 1043 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- http/wpt/service-workers/form-data-upload.html --------------------
The bot gtk-release completed 924 runs on the interval [301594@main-305588@main]
Frecuency of results for test: http/wpt/service-workers/form-data-upload.html
615 times [66.6%] -> NOERROR
59 times [6.4%] -> TEXT
250 times [27.1%] -> TEXT PASS
Of those 924 runs it didn't match the expectation 309 times [33.4%]
Details of the type and frequency of unmatched expectations:
59 times [6.4%] -> TEXT (Expected: PASS)
250 times [27.1%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 52.3%
- This test was flaky on 52.3% of the 924 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 927 runs on the interval [301599@main-305599@main]
Frecuency of results for test: http/wpt/service-workers/form-data-upload.html
729 times [78.6%] -> NOERROR
160 times [17.3%] -> TEXT PASS
38 times [4.1%] -> TEXT
Of those 927 runs it didn't match the expectation 198 times [21.4%]
Details of the type and frequency of unmatched expectations:
160 times [17.3%] -> TEXT PASS (Expected: PASS)
38 times [4.1%] -> TEXT (Expected: PASS)
Flakiness factor: 37.1%
- This test was flaky on 37.1% of the 927 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- imported/w3c/web-platform-tests/css/css-anchor-position/position-area-overflow-icb-002.html --------------------
The bot gtk-release completed 932 runs on the interval [301594@main-305588@main]
Frecuency of results for test: imported/w3c/web-platform-tests/css/css-anchor-position/position-area-overflow-icb-002.html
153 times [16.4%] -> IMAGE PASS
686 times [73.6%] -> NOERROR
93 times [10.0%] -> IMAGE
Of those 932 runs it didn't match the expectation 246 times [26.4%]
Details of the type and frequency of unmatched expectations:
153 times [16.4%] -> IMAGE PASS (Expected: PASS)
93 times [10.0%] -> IMAGE (Expected: PASS)
Flakiness factor: 40.3%
- This test was flaky on 40.3% of the 932 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 1019 runs on the interval [301599@main-305599@main]
Frecuency of results for test: imported/w3c/web-platform-tests/css/css-anchor-position/position-area-overflow-icb-002.html
249 times [24.4%] -> IMAGE PASS
150 times [14.7%] -> NOERROR
620 times [60.8%] -> IMAGE
Of those 1019 runs it didn't match the expectation 869 times [85.3%]
Details of the type and frequency of unmatched expectations:
249 times [24.4%] -> IMAGE PASS (Expected: PASS)
620 times [60.8%] -> IMAGE (Expected: PASS)
Flakiness factor: 56.1%
- This test was flaky on 56.1% of the 1019 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- imported/w3c/web-platform-tests/css/css-view-transitions/transform-origin-view-transition-group.html --------------------
The bot gtk-release completed 924 runs on the interval [301594@main-305588@main]
Frecuency of results for test: imported/w3c/web-platform-tests/css/css-view-transitions/transform-origin-view-transition-group.html
298 times [32.3%] -> IMAGE PASS
98 times [10.6%] -> IMAGE
528 times [57.1%] -> NOERROR
Of those 924 runs it didn't match the expectation 396 times [42.9%]
Details of the type and frequency of unmatched expectations:
298 times [32.3%] -> IMAGE PASS (Expected: PASS)
98 times [10.6%] -> IMAGE (Expected: PASS)
Flakiness factor: 59.3%
- This test was flaky on 59.3% of the 924 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 979 runs on the interval [301599@main-305599@main]
Frecuency of results for test: imported/w3c/web-platform-tests/css/css-view-transitions/transform-origin-view-transition-group.html
398 times [40.7%] -> IMAGE PASS
441 times [45.0%] -> NOERROR
140 times [14.3%] -> IMAGE
Of those 979 runs it didn't match the expectation 538 times [55.0%]
Details of the type and frequency of unmatched expectations:
398 times [40.7%] -> IMAGE PASS (Expected: PASS)
140 times [14.3%] -> IMAGE (Expected: PASS)
Flakiness factor: 68.1%
- This test was flaky on 68.1% of the 979 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- imported/w3c/web-platform-tests/fullscreen/rendering/fullscreen-pseudo-class.html --------------------
The bot gtk-release completed 900 runs on the interval [301594@main-305588@main]
Frecuency of results for test: imported/w3c/web-platform-tests/fullscreen/rendering/fullscreen-pseudo-class.html
862 times [95.8%] -> NOERROR
14 times [1.6%] -> TEXT
24 times [2.7%] -> TEXT PASS
Of those 900 runs it didn't match the expectation 38 times [4.2%]
Details of the type and frequency of unmatched expectations:
14 times [1.6%] -> TEXT (Expected: PASS)
24 times [2.7%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 6.8%
- This test was flaky on 6.8% of the 900 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 965 runs on the interval [301599@main-305599@main]
Frecuency of results for test: imported/w3c/web-platform-tests/fullscreen/rendering/fullscreen-pseudo-class.html
419 times [43.4%] -> NOERROR
184 times [19.1%] -> TEXT PASS
361 times [37.4%] -> TEXT
1 times [0.1%] -> TEXT TIMEOUT
Of those 965 runs it didn't match the expectation 546 times [56.6%]
Details of the type and frequency of unmatched expectations:
184 times [19.1%] -> TEXT PASS (Expected: PASS)
361 times [37.4%] -> TEXT (Expected: PASS)
1 times [0.1%] -> TEXT TIMEOUT (Expected: PASS)
Flakiness factor: 59.0%
- This test was flaky on 59.0% of the 965 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- imported/w3c/web-platform-tests/fullscreen/rendering/fullscreen-root-block-scroll.html --------------------
The bot gtk-release completed 890 runs on the interval [301594@main-305588@main]
Frecuency of results for test: imported/w3c/web-platform-tests/fullscreen/rendering/fullscreen-root-block-scroll.html
879 times [98.8%] -> NOERROR
9 times [1.0%] -> TEXT PASS
2 times [0.2%] -> TEXT
Of those 890 runs it didn't match the expectation 11 times [1.2%]
Details of the type and frequency of unmatched expectations:
9 times [1.0%] -> TEXT PASS (Expected: PASS)
2 times [0.2%] -> TEXT (Expected: PASS)
Flakiness factor: 2.4%
- This test was flaky on 2.4% of the 890 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 936 runs on the interval [301599@main-305599@main]
Frecuency of results for test: imported/w3c/web-platform-tests/fullscreen/rendering/fullscreen-root-block-scroll.html
608 times [65.0%] -> NOERROR
128 times [13.7%] -> TEXT
199 times [21.3%] -> TEXT PASS
1 times [0.1%] -> TIMEOUT TEXT
Of those 936 runs it didn't match the expectation 328 times [35.0%]
Details of the type and frequency of unmatched expectations:
128 times [13.7%] -> TEXT (Expected: PASS)
199 times [21.3%] -> TEXT PASS (Expected: PASS)
1 times [0.1%] -> TIMEOUT TEXT (Expected: PASS)
Flakiness factor: 50.7%
- This test was flaky on 50.7% of the 936 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- imported/w3c/web-platform-tests/fullscreen/rendering/ua-style-iframe.html --------------------
The bot gtk-release completed 897 runs on the interval [301594@main-305588@main]
Frecuency of results for test: imported/w3c/web-platform-tests/fullscreen/rendering/ua-style-iframe.html
868 times [96.8%] -> NOERROR
20 times [2.2%] -> TEXT PASS
9 times [1.0%] -> TEXT
Of those 897 runs it didn't match the expectation 29 times [3.2%]
Details of the type and frequency of unmatched expectations:
20 times [2.2%] -> TEXT PASS (Expected: PASS)
9 times [1.0%] -> TEXT (Expected: PASS)
Flakiness factor: 5.1%
- This test was flaky on 5.1% of the 897 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 937 runs on the interval [301599@main-305599@main]
Frecuency of results for test: imported/w3c/web-platform-tests/fullscreen/rendering/ua-style-iframe.html
536 times [57.2%] -> NOERROR
167 times [17.8%] -> TEXT PASS
234 times [25.0%] -> TEXT
Of those 937 runs it didn't match the expectation 401 times [42.8%]
Details of the type and frequency of unmatched expectations:
167 times [17.8%] -> TEXT PASS (Expected: PASS)
234 times [25.0%] -> TEXT (Expected: PASS)
Flakiness factor: 54.2%
- This test was flaky on 54.2% of the 937 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/media_fragment_seek.html --------------------
The bot gtk-release completed 924 runs on the interval [301594@main-305588@main]
Frecuency of results for test: imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/media_fragment_seek.html
304 times [32.9%] -> NOERROR
129 times [14.0%] -> TEXT PASS
491 times [53.1%] -> TEXT
Of those 924 runs it didn't match the expectation 620 times [67.1%]
Details of the type and frequency of unmatched expectations:
129 times [14.0%] -> TEXT PASS (Expected: PASS)
491 times [53.1%] -> TEXT (Expected: PASS)
Flakiness factor: 59.8%
- This test was flaky on 59.8% of the 924 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 940 runs on the interval [301599@main-305599@main]
Frecuency of results for test: imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/media_fragment_seek.html
482 times [51.3%] -> TEXT
368 times [39.1%] -> NOERROR
90 times [9.6%] -> TEXT PASS
Of those 940 runs it didn't match the expectation 572 times [60.9%]
Details of the type and frequency of unmatched expectations:
482 times [51.3%] -> TEXT (Expected: PASS)
90 times [9.6%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 56.4%
- This test was flaky on 56.4% of the 940 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- imported/w3c/web-platform-tests/service-workers/service-worker/fetch-request-redirect.https.html --------------------
The bot gtk-release completed 923 runs on the interval [301594@main-305588@main]
Frecuency of results for test: imported/w3c/web-platform-tests/service-workers/service-worker/fetch-request-redirect.https.html
614 times [66.5%] -> TEXT
209 times [22.6%] -> NOERROR
100 times [10.8%] -> TEXT PASS
Of those 923 runs it didn't match the expectation 714 times [77.4%]
Details of the type and frequency of unmatched expectations:
614 times [66.5%] -> TEXT (Expected: PASS)
100 times [10.8%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 49.0%
- This test was flaky on 49.0% of the 923 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 940 runs on the interval [301599@main-305599@main]
Frecuency of results for test: imported/w3c/web-platform-tests/service-workers/service-worker/fetch-request-redirect.https.html
675 times [71.8%] -> TEXT
168 times [17.9%] -> NOERROR
97 times [10.3%] -> TEXT PASS
Of those 940 runs it didn't match the expectation 772 times [82.1%]
Details of the type and frequency of unmatched expectations:
675 times [71.8%] -> TEXT (Expected: PASS)
97 times [10.3%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 42.9%
- This test was flaky on 42.9% of the 940 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- imported/w3c/web-platform-tests/service-workers/service-worker/skip-waiting-installed.https.html --------------------
The bot gtk-release completed 888 runs on the interval [301594@main-305588@main]
Frecuency of results for test: imported/w3c/web-platform-tests/service-workers/service-worker/skip-waiting-installed.https.html
690 times [77.7%] -> NOERROR
80 times [9.0%] -> TEXT
118 times [13.3%] -> TEXT PASS
Of those 888 runs it didn't match the expectation 198 times [22.3%]
Details of the type and frequency of unmatched expectations:
80 times [9.0%] -> TEXT (Expected: PASS)
118 times [13.3%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 29.8%
- This test was flaky on 29.8% of the 888 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 904 runs on the interval [301599@main-305599@main]
Frecuency of results for test: imported/w3c/web-platform-tests/service-workers/service-worker/skip-waiting-installed.https.html
714 times [79.0%] -> NOERROR
112 times [12.4%] -> TEXT PASS
78 times [8.6%] -> TEXT
Of those 904 runs it didn't match the expectation 190 times [21.0%]
Details of the type and frequency of unmatched expectations:
112 times [12.4%] -> TEXT PASS (Expected: PASS)
78 times [8.6%] -> TEXT (Expected: PASS)
Flakiness factor: 31.0%
- This test was flaky on 31.0% of the 904 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- imported/w3c/web-platform-tests/webstorage/event_case_sensitive.html --------------------
The bot gtk-release completed 919 runs on the interval [301594@main-305588@main]
Frecuency of results for test: imported/w3c/web-platform-tests/webstorage/event_case_sensitive.html
345 times [37.5%] -> TEXT PASS
299 times [32.5%] -> NOERROR
269 times [29.3%] -> TEXT
5 times [0.5%] -> TEXT TIMEOUT
1 times [0.1%] -> TEXT CRASH
Of those 919 runs it didn't match the expectation 620 times [67.5%]
Details of the type and frequency of unmatched expectations:
345 times [37.5%] -> TEXT PASS (Expected: PASS)
269 times [29.3%] -> TEXT (Expected: PASS)
5 times [0.5%] -> TEXT TIMEOUT (Expected: PASS)
1 times [0.1%] -> TEXT CRASH (Expected: PASS)
Flakiness factor: 73.3%
- This test was flaky on 73.3% of the 919 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 928 runs on the interval [301599@main-305599@main]
Frecuency of results for test: imported/w3c/web-platform-tests/webstorage/event_case_sensitive.html
325 times [35.0%] -> TEXT PASS
346 times [37.3%] -> NOERROR
254 times [27.4%] -> TEXT
3 times [0.3%] -> TEXT TIMEOUT
Of those 928 runs it didn't match the expectation 582 times [62.7%]
Details of the type and frequency of unmatched expectations:
325 times [35.0%] -> TEXT PASS (Expected: PASS)
254 times [27.4%] -> TEXT (Expected: PASS)
3 times [0.3%] -> TEXT TIMEOUT (Expected: PASS)
Flakiness factor: 67.0%
- This test was flaky on 67.0% of the 928 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- webanimations/focus-accelerated-animated-element-initially-in-overflow.html --------------------
The bot gtk-release completed 909 runs on the interval [301594@main-305588@main]
Frecuency of results for test: webanimations/focus-accelerated-animated-element-initially-in-overflow.html
288 times [31.7%] -> TEXT
621 times [68.3%] -> TEXT PASS
Of those 909 runs it didn't match the expectation 909 times [100%]
Details of the type and frequency of unmatched expectations:
288 times [31.7%] -> TEXT (Expected: PASS)
621 times [68.3%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 86.7%
- This test was flaky on 86.7% of the 909 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 910 runs on the interval [301599@main-305599@main]
Frecuency of results for test: webanimations/focus-accelerated-animated-element-initially-in-overflow.html
338 times [37.1%] -> TEXT PASS
61 times [6.7%] -> TEXT
511 times [56.2%] -> NOERROR
Of those 910 runs it didn't match the expectation 399 times [43.8%]
Details of the type and frequency of unmatched expectations:
338 times [37.1%] -> TEXT PASS (Expected: PASS)
61 times [6.7%] -> TEXT (Expected: PASS)
Flakiness factor: 63.0%
- This test was flaky on 63.0% of the 910 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- webgl/1.0.x/conformance/textures/misc/video-rotation.html --------------------
The bot gtk-release completed 890 runs on the interval [301594@main-305588@main]
Frecuency of results for test: webgl/1.0.x/conformance/textures/misc/video-rotation.html
560 times [62.9%] -> NOERROR
205 times [23.0%] -> TEXT PASS
125 times [14.0%] -> TEXT
Of those 890 runs it didn't match the expectation 330 times [37.1%]
Details of the type and frequency of unmatched expectations:
205 times [23.0%] -> TEXT PASS (Expected: PASS)
125 times [14.0%] -> TEXT (Expected: PASS)
Flakiness factor: 48.2%
- This test was flaky on 48.2% of the 890 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 903 runs on the interval [301599@main-305599@main]
Frecuency of results for test: webgl/1.0.x/conformance/textures/misc/video-rotation.html
651 times [72.1%] -> NOERROR
3 times [0.3%] -> TEXT TIMEOUT
189 times [20.9%] -> TEXT PASS
1 times [0.1%] -> TIMEOUT PASS
59 times [6.5%] -> TEXT
Of those 903 runs it didn't match the expectation 252 times [27.9%]
Details of the type and frequency of unmatched expectations:
3 times [0.3%] -> TEXT TIMEOUT (Expected: PASS)
189 times [20.9%] -> TEXT PASS (Expected: PASS)
1 times [0.1%] -> TIMEOUT PASS (Expected: PASS)
59 times [6.5%] -> TEXT (Expected: PASS)
Flakiness factor: 40.4%
- This test was flaky on 40.4% of the 903 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
-------------------- webgl/2.0.y/conformance/textures/misc/video-rotation.html --------------------
The bot gtk-release completed 888 runs on the interval [301594@main-305588@main]
Frecuency of results for test: webgl/2.0.y/conformance/textures/misc/video-rotation.html
646 times [72.7%] -> NOERROR
131 times [14.8%] -> TEXT PASS
111 times [12.5%] -> TEXT
Of those 888 runs it didn't match the expectation 242 times [27.3%]
Details of the type and frequency of unmatched expectations:
131 times [14.8%] -> TEXT PASS (Expected: PASS)
111 times [12.5%] -> TEXT (Expected: PASS)
Flakiness factor: 39.2%
- This test was flaky on 39.2% of the 888 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 903 runs on the interval [301599@main-305599@main]
Frecuency of results for test: webgl/2.0.y/conformance/textures/misc/video-rotation.html
723 times [80.1%] -> NOERROR
133 times [14.7%] -> TEXT PASS
47 times [5.2%] -> TEXT
Of those 903 runs it didn't match the expectation 180 times [19.9%]
Details of the type and frequency of unmatched expectations:
133 times [14.7%] -> TEXT PASS (Expected: PASS)
47 times [5.2%] -> TEXT (Expected: PASS)
Flakiness factor: 32.0%
- This test was flaky on 32.0% of the 903 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
-------------------------------------------------------------------------------------
| Attachments | ||
|---|---|---|
| Add attachment proposed patch, testcase, etc. |
Carlos Alberto Lopez Perez
report of fullscreen/fullscreen-enter-bottom-padding-animation.html moved to bug 305502
Carlos Alberto Lopez Perez
report of imported/w3c/web-platform-tests/service-workers/service-worker/fetch-request-redirect.https.html moved to 305503
Carlos Alberto Lopez Perez
report of imported/w3c/web-platform-tests/service-workers/service-worker/fetch-request-redirect.https.html moved to bug 305503
Carlos Alberto Lopez Perez
Expectations updated at 305610@main
Lauro Moura
Adding to the list a few more:
--------- fullscreen/fullscreen-zero-height-element-with-non-zero-children.html -----------
The bot gtk-release completed 944 runs on the interval [301526@main-305524@main]
Frecuency of results for test: fullscreen/fullscreen-zero-height-element-with-non-zero-children.html
508 times [53.8%] -> NOERROR
220 times [23.3%] -> TEXT PASS
216 times [22.9%] -> TEXT
Of those 944 runs it didn't match the expectation 436 times [46.2%]
Details of the type and frequency of unmatched expectations:
220 times [23.3%] -> TEXT PASS (Expected: PASS)
216 times [22.9%] -> TEXT (Expected: PASS)
Flakiness factor: 61.7%
- This test was flaky on 61.7% of the 944 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot wpe-release completed 1017 runs on the interval [301527@main-305525@main]
Frecuency of results for test: fullscreen/fullscreen-zero-height-element-with-non-zero-children.html
215 times [21.1%] -> TEXT PASS
414 times [40.7%] -> NOERROR
388 times [38.2%] -> TEXT
Of those 1017 runs it didn't match the expectation 603 times [59.3%]
Details of the type and frequency of unmatched expectations:
215 times [21.1%] -> TEXT PASS (Expected: PASS)
388 times [38.2%] -> TEXT (Expected: PASS)
Flakiness factor: 66.4%
- This test was flaky on 66.4% of the 1017 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
------------ fast/forms/validation-message-appearance.html ------------------
bug102463
The bot wpe-release completed 916 runs on the interval [301527@main-305525@main]
Frecuency of results for test: fast/forms/validation-message-appearance.html
856 times [93.4%] -> NOERROR
48 times [5.2%] -> TEXT MISSING
12 times [1.3%] -> TEXT
Of those 916 runs it didn't match the expectation 60 times [6.6%]
Details of the type and frequency of unmatched expectations:
48 times [5.2%] -> TEXT MISSING (Expected: PASS)
12 times [1.3%] -> TEXT (Expected: PASS)
Flakiness factor: 12.4%
- This test was flaky on 12.4% of the 916 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
----------------- fast/images/async-image-multiple-clients-repaint.html -----------------------
bug305538
The bot wpe-release completed 920 runs on the interval [301527@main-305525@main]
Frecuency of results for test: fast/images/async-image-multiple-clients-repaint.html
840 times [91.3%] -> NOERROR
64 times [7.0%] -> TEXT MISSING
16 times [1.7%] -> TEXT
Of those 920 runs it didn't match the expectation 80 times [8.7%]
Details of the type and frequency of unmatched expectations:
64 times [7.0%] -> TEXT MISSING (Expected: PASS)
16 times [1.7%] -> TEXT (Expected: PASS)
Flakiness factor: 16.0%
- This test was flaky on 16.0% of the 920 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
The bot gtk-release completed 901 runs on the interval [301526@main-305524@main]
Frecuency of results for test: fast/images/async-image-multiple-clients-repaint.html
794 times [88.1%] -> NOERROR
98 times [10.9%] -> TEXT MISSING
9 times [1.0%] -> TEXT
Of those 901 runs it didn't match the expectation 107 times [11.9%]
Details of the type and frequency of unmatched expectations:
98 times [10.9%] -> TEXT MISSING (Expected: PASS)
9 times [1.0%] -> TEXT (Expected: PASS)
Flakiness factor: 21.0%
- This test was flaky on 21.0% of the 901 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
Lauro Moura
Pull request: https://github.com/WebKit/WebKit/pull/56616
EWS
Test gardening commit 305628@main (0ce225948183): <https://commits.webkit.org/305628@main>
Reviewed commits have been landed. Closing PR #56616 and removing active labels.