Bug 215450 - [ macOS ] imported/w3c/web-platform-tests/media-source/mediasource-changetype-play-negative.html is a flaky failure
Summary: [ macOS ] imported/w3c/web-platform-tests/media-source/mediasource-changetype...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-08-13 08:11 PDT by Hector Lopez
Modified: 2020-08-13 08:24 PDT (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Hector Lopez 2020-08-13 08:11:57 PDT
imported/w3c/web-platform-tests/media-source/mediasource-changetype-play-negative.html

Test is a flaky failure according to history on macOS. The first occurrence of failure was at r264379. That occurrence happens on the same day as resync https://trac.webkit.org/changeset/264345/webkit

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2Fmediasource-changetype-play-negative.html&limit=50000&platform=mac

Diff:
--- /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-changetype-play-negative-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/media-source/mediasource-changetype-play-negative-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS Check if browser supports enough test media types across audio and video for changeType negative tests 
 PASS Negative test audio<->video changeType for audio/mp4; codecs="mp4a.40.2" <-> video/mp4; codecs="avc1.4D4001" 
@@ -8,7 +10,7 @@
 PASS Negative test video<->audio changeType for video/mp4; codecs="avc1.4D4001" <-> audio/mp4; codecs="mp4a.40.2" (using types without codecs parameters) 
 PASS Negative test audio<->video implicit changeType for audio/mp4; codecs="mp4a.40.2" <-> video/mp4; codecs="avc1.4D4001" (without codecs parameters for addSourceBuffer) 
 PASS Negative test video<->audio implicit changeType for video/mp4; codecs="avc1.4D4001" <-> audio/mp4; codecs="mp4a.40.2" (without codecs parameters for addSourceBuffer) 
-FAIL Negative test audio<->video changeType for audio/mpeg <-> video/mp4; codecs="avc1.4D4001" assert_unreached: Received 'ended' while negative testing. Reached unreachable code
+TIMEOUT Negative test audio<->video changeType for audio/mpeg <-> video/mp4; codecs="avc1.4D4001" Test timed out
 FAIL Negative test video<->audio changeType for video/mp4; codecs="avc1.4D4001" <-> audio/mpeg assert_unreached: Received 'ended' while negative testing. Reached unreachable code
 FAIL Negative test audio<->video changeType for audio/mpeg <-> video/mp4; codecs="avc1.4D4001" (using types without codecs parameters) assert_unreached: Received 'ended' while negative testing. Reached unreachable code
 FAIL Negative test video<->audio changeType for video/mp4; codecs="avc1.4D4001" <-> audio/mpeg (using types without codecs parameters) assert_unreached: Received 'ended' while negative testing. Reached unreachable code
Comment 1 Radar WebKit Bug Importer 2020-08-13 08:12:24 PDT
<rdar://problem/66991189>
Comment 2 Hector Lopez 2020-08-13 08:24:59 PDT
Test expectation while investigated:

https://trac.webkit.org/changeset/265605/webkit