Bug 263226 – REGRESSION(268692@main?): [ macOS ] 7 tests under imported/w3c/web-platform-tests/media-source/mediasource-* are flaky failures.

• Component: Media
• Status: NEW

[Ben Schwartz]

The following tests are flaky failures on macOS (being more consistent on wk1 debug):

imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-av-audio-bitrate.html
imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-av-video-bitrate.html
imported/w3c/web-platform-tests/media-source/mediasource-play-then-seek-back.html
imported/w3c/web-platform-tests/media-source/mediasource-play.html
imported/w3c/web-platform-tests/media-source/mediasource-redundant-seek.html
imported/w3c/web-platform-tests/media-source/mediasource-remove-preserves-currentTime.html
imported/w3c/web-platform-tests/media-source/mediasource-remove.html

HISTORY:

https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-config-change-mp4-av-audio-bitrate.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-config-change-mp4-av-video-bitrate.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-play-then-seek-back.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-play.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-redundant-seek.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-remove-preserves-currentTime.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-remove.html

TEXT DIFF:

-PASS Tests mp4 audio bitrate changes in multiplexed content.
+FAIL Tests mp4 audio bitrate changes in multiplexed content. assert_equals: Event types match. expected "update" but got "updateend"

DIFF URL:

https://build.webkit.org/results/Apple-Sonoma-Debug-AppleSilicon-WK2-Tests/269370@main%20(208)/imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-av-audio-bitrate-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this issue on macOS Sonoma (14.0, 23A344/arm64) ToT using the following command:

run-webkit-tests -1 --debug --clobber-old-results --iterations 100 --child-processes 10 -f imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-av-audio-bitrate.html imported/w3c/web-platform-tests/media-source/mediasource-config-change-mp4-av-video-bitrate.html imported/w3c/web-platform-tests/media-source/mediasource-play-then-seek-back.html imported/w3c/web-platform-tests/media-source/mediasource-play.html imported/w3c/web-platform-tests/media-source/mediasource-redundant-seek.html imported/w3c/web-platform-tests/media-source/mediasource-remove-preserves-currentTime.html imported/w3c/web-platform-tests/media-source/mediasource-remove.html

REGRESSION:

I was able to identify a potential regression point at 268692@main. Changes at this point seem to be related to this issue; however, I am not sure.

[Radar WebKit Bug Importer]

<rdar://problem/117044354>

[Ben Schwartz]

I observed a couple of isolated instances of crashes/timeouts on some of the tests; however, I decided not to file those as part of this test gardening commit since they could be isolated/separate issues.

[EWS]

Test gardening commit 269389@main (418b7e23c9ec): <https://commits.webkit.org/269389@main>

Reviewed commits have been landed. Closing PR #19139 and removing active labels.