Bug 190976 – REGRESSION (r234940): [ MacOS ] Layout Test imported/w3c/web-platform-tests/media-source/mediasource-changetype-play.html is flaky

• Status: NEW
• Component: Tools / Tests

[Truitt Savell]

The following layout test is flaky on MacOS

imported/w3c/web-platform-tests/media-source/mediasource-changetype-play.html

Probable cause:

Test was added in: https://trac.webkit.org/changeset/234940/webkit

Test can be reproduced with:

run-webkit-tests --root debug-236084 imported/w3c/web-platform-tests/media-source/mediasource-changetype-play.html --iterations 500 -f --debug

The test will have a failure less than 1/100 times.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-changetype-play.html

Diff:
--- /Volumes/Data/slave/highsierra-release-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-changetype-play-expected.txt
+++ /Volumes/Data/slave/highsierra-release-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-changetype-play-actual.txt
@@ -1,8 +1,10 @@
+
+Harness Error (TIMEOUT), message = null
 
 FAIL Check if browser supports enough test media types assert_true: Browser doesn't support at least 2 types of video test media expected true got false
 PASS Test audio-only changeType for audio/mp4; codecs="mp4a.40.2" <-> audio/mp4; codecs="mp4a.40.2" 
 PASS Test audio-only changeType for audio/mp4; codecs="mp4a.40.2" <-> audio/mpeg 
 PASS Test audio-only changeType for audio/mpeg <-> audio/mp4; codecs="mp4a.40.2" 
-PASS Test audio-only changeType for audio/mpeg <-> audio/mpeg 
+TIMEOUT Test audio-only changeType for audio/mpeg <-> audio/mpeg Test timed out
 PASS Test video-only changeType for video/mp4; codecs="avc1.4D4001" <-> video/mp4; codecs="avc1.4D4001"

[Radar WebKit Bug Importer]

<rdar://problem/45602861>

[Ryan Haddad]

Marked test as flaky in https://trac.webkit.org/r239382