[ Mac wk2 ] imported/w3c/web-platform-tests/mediacapture-streams/MediaStream tests are flaky failing.

• Component: Media
• Status: NEW ---

[Jason Lawrence]

imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-srcObject.https.html 
imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html
imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html

Description:
These tests are flaky failing on Mac wk2. The tests started flaky failing in the first week of March.

History:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-streams%2FMediaStream-MediaElement-srcObject.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-streams%2FMediaStream-removetrack.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-streams%2FMediaStream-removetrack.https.html&platform=mac&limit=50000#recent=false

Diff:
--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-firstframe.https-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-firstframe.https-actual.txt
@@ -6,6 +6,6 @@
 
 
 
-PASS Tests that loading a MediaStream in a media element eventually results in "canplay" even when not playing or autoplaying 
-PASS Tests that loading a MediaStream in a media element sees all the expected (deterministic) events even when not playing or autoplaying 
+FAIL Tests that loading a MediaStream in a media element eventually results in "canplay" even when not playing or autoplaying promise_test: Unhandled rejection with value: object "Error: canplay timeout"
+FAIL Tests that loading a MediaStream in a media element sees all the expected (deterministic) events even when not playing or autoplaying promise_test: Unhandled rejection with value: object "Error: durationchange timeout"

Diff:
--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-srcObject.https-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-srcObject.https-actual.txt
@@ -10,8 +10,8 @@
 
 PASS Tests that a MediaStream can be assigned to a video element with srcObject 
 PASS Tests that a MediaStream assigned to a video element is not seekable 
-PASS Tests that a MediaStream assigned to a video element is in readyState HAVE_NOTHING initially 
-TIMEOUT Tests that a MediaStream assigned to a video element has expected duration Test timed out
+TIMEOUT Tests that a MediaStream assigned to a video element is in readyState HAVE_NOTHING initially Test timed out
+NOTRUN Tests that a MediaStream assigned to a video element has expected duration 
 NOTRUN Tests that a video element with a MediaStream assigned is not preloaded 
 NOTRUN Tests that a video element with a MediaStream assigned ignores playbackRate attributes (defaultPlaybackRate is identical) 
 NOTRUN Tests that a video element with a MediaStream assigned ignores playbackRate attributes (defaultPlaybackRate is different) 

Diff:
--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https-actual.txt
@@ -6,7 +6,9 @@
 
 
 
+Harness Error (TIMEOUT), message = null
+
 PASS Tests that a removal from a MediaStream works as expected 
-PASS Test that removal from a MediaStream fires ended on media elements (video first) 
-FAIL Test that removal from a MediaStream fires ended on media elements (audio first) assert_equals: audio element ended because no more audio tracks expected true but got false
+TIMEOUT Test that removal from a MediaStream fires ended on media elements (video first) Test timed out
+NOTRUN Test that removal from a MediaStream fires ended on media elements (audio first)

[Radar WebKit Bug Importer]

<rdar://problem/60508911>

[Jason Lawrence]

I have marked the three tests as failing while this issue is investigated.
https://trac.webkit.org/changeset/258517/webkit

imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-srcObject.https.html
imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html
imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-firstframe.https.html