Bug 259658 – REGRESSION (257403@main?): [ macOS ] http/tests/media/video-play-stall.html is a flaky failure

• Status: NEW
• Component: Media

[Ben Schwartz]

http/tests/media/video-play-stall.html

This test has been a flaky failure on all platforms as far as the flakiness dashboard extends.

TEXT DIFF:

 EVENT(loadedmetadata)
 EVENT(loadeddata)
 EVENT(stalled)
-TEST(video.currentTime <= bufferedend) OK
+TEST(video.currentTime <= bufferedend) FAIL
 TEST(gotCanplay ? video.paused == false : video.paused == true) OK
 EXPECTED (video.playbackRate === '1') OK
 TEST(video.duration > bufferedend) OK

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Debug-AppleSilicon-WK2-Tests/266142@main%20(3111)/http/tests/media/video-play-stall-pretty-diff.html

[Radar WebKit Bug Importer]

<rdar://problem/113157201>

[Ben Schwartz]

I have marked this test as a flaky failure while this issue is investigated. (Link: https://github.com/WebKit/WebKit/pull/16240)

[Ben Schwartz]

History link: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fmedia%2Fvideo-play-stall.html

[Ben Schwartz]

I was unable to reproduce this bug on macOS Ventura arm64; however, I suspect this may be due to how videos are loaded and buffered in certain environments (given that the error is because the video's current time is greater than the buffered time). Either way, more investigation is needed to be sure.

[Karl Rackler]

This issue can be reproduced using command:
run-webkit-tests --release -f --clobber-old-results --exit-after-n-failures 1 --force  --child-processes=5 --iterations=100 http/tests/media/video-play-stall.html

[EWS]

Test gardening commit 266474@main (c22c66c0cc2e): <https://commits.webkit.org/266474@main>

Reviewed commits have been landed. Closing PR #16240 and removing active labels.

[Ryan Haddad]

It looks like https://commits.webkit.org/257403@main is when the test became flaky