Bug 190976 - REGRESSION (r234940): [ MacOS ] Layout Test imported/w3c/web-platform-tests/media-source/mediasource-changetype-play.html is flaky
Summary: REGRESSION (r234940): [ MacOS ] Layout Test imported/w3c/web-platform-tests/m...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2018-10-26 16:12 PDT by Truitt Savell
Modified: 2018-12-19 11:27 PST (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Truitt Savell 2018-10-26 16:12:17 PDT
The following layout test is flaky on MacOS

imported/w3c/web-platform-tests/media-source/mediasource-changetype-play.html

Probable cause:

Test was added in: https://trac.webkit.org/changeset/234940/webkit

Test can be reproduced with:

run-webkit-tests --root debug-236084 imported/w3c/web-platform-tests/media-source/mediasource-changetype-play.html --iterations 500 -f --debug

The test will have a failure less than 1/100 times.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-changetype-play.html

Diff:
--- /Volumes/Data/slave/highsierra-release-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-changetype-play-expected.txt
+++ /Volumes/Data/slave/highsierra-release-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-changetype-play-actual.txt
@@ -1,8 +1,10 @@
+
+Harness Error (TIMEOUT), message = null
 
 FAIL Check if browser supports enough test media types assert_true: Browser doesn't support at least 2 types of video test media expected true got false
 PASS Test audio-only changeType for audio/mp4; codecs="mp4a.40.2" <-> audio/mp4; codecs="mp4a.40.2" 
 PASS Test audio-only changeType for audio/mp4; codecs="mp4a.40.2" <-> audio/mpeg 
 PASS Test audio-only changeType for audio/mpeg <-> audio/mp4; codecs="mp4a.40.2" 
-PASS Test audio-only changeType for audio/mpeg <-> audio/mpeg 
+TIMEOUT Test audio-only changeType for audio/mpeg <-> audio/mpeg Test timed out
 PASS Test video-only changeType for video/mp4; codecs="avc1.4D4001" <-> video/mp4; codecs="avc1.4D4001"
Comment 1 Radar WebKit Bug Importer 2018-10-26 16:14:27 PDT
<rdar://problem/45602861>
Comment 2 Ryan Haddad 2018-12-19 11:27:03 PST
Marked test as flaky in https://trac.webkit.org/r239382