Bug 209148 - [ Mac wk2 ] imported/w3c/web-platform-tests/mediacapture-streams/MediaStream tests are flaky failing.
Summary: [ Mac wk2 ] imported/w3c/web-platform-tests/mediacapture-streams/MediaStream ...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Media (show other bugs)
Version: WebKit Nightly Build
Hardware: Macintosh macOS 10.15
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-03-16 13:47 PDT by Jason Lawrence
Modified: 2020-03-16 13:56 PDT (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jason Lawrence 2020-03-16 13:47:19 PDT
imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-srcObject.https.html 
imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html
imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html

Description:
These tests are flaky failing on Mac wk2. The tests started flaky failing in the first week of March.

History:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-streams%2FMediaStream-MediaElement-srcObject.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-streams%2FMediaStream-removetrack.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-streams%2FMediaStream-removetrack.https.html&platform=mac&limit=50000#recent=false

Diff:
--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-firstframe.https-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-firstframe.https-actual.txt
@@ -6,6 +6,6 @@
 
 
 
-PASS Tests that loading a MediaStream in a media element eventually results in "canplay" even when not playing or autoplaying 
-PASS Tests that loading a MediaStream in a media element sees all the expected (deterministic) events even when not playing or autoplaying 
+FAIL Tests that loading a MediaStream in a media element eventually results in "canplay" even when not playing or autoplaying promise_test: Unhandled rejection with value: object "Error: canplay timeout"
+FAIL Tests that loading a MediaStream in a media element sees all the expected (deterministic) events even when not playing or autoplaying promise_test: Unhandled rejection with value: object "Error: durationchange timeout"

Diff:
--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-srcObject.https-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-srcObject.https-actual.txt
@@ -10,8 +10,8 @@
 
 PASS Tests that a MediaStream can be assigned to a video element with srcObject 
 PASS Tests that a MediaStream assigned to a video element is not seekable 
-PASS Tests that a MediaStream assigned to a video element is in readyState HAVE_NOTHING initially 
-TIMEOUT Tests that a MediaStream assigned to a video element has expected duration Test timed out
+TIMEOUT Tests that a MediaStream assigned to a video element is in readyState HAVE_NOTHING initially Test timed out
+NOTRUN Tests that a MediaStream assigned to a video element has expected duration 
 NOTRUN Tests that a video element with a MediaStream assigned is not preloaded 
 NOTRUN Tests that a video element with a MediaStream assigned ignores playbackRate attributes (defaultPlaybackRate is identical) 
 NOTRUN Tests that a video element with a MediaStream assigned ignores playbackRate attributes (defaultPlaybackRate is different) 

Diff:
--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https-actual.txt
@@ -6,7 +6,9 @@
 
 
 
+Harness Error (TIMEOUT), message = null
+
 PASS Tests that a removal from a MediaStream works as expected 
-PASS Test that removal from a MediaStream fires ended on media elements (video first) 
-FAIL Test that removal from a MediaStream fires ended on media elements (audio first) assert_equals: audio element ended because no more audio tracks expected true but got false
+TIMEOUT Test that removal from a MediaStream fires ended on media elements (video first) Test timed out
+NOTRUN Test that removal from a MediaStream fires ended on media elements (audio first)
Comment 1 Radar WebKit Bug Importer 2020-03-16 13:47:49 PDT
<rdar://problem/60508911>
Comment 2 Jason Lawrence 2020-03-16 13:56:24 PDT
I have marked the three tests as failing while this issue is investigated.
https://trac.webkit.org/changeset/258517/webkit

imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-srcObject.https.html
imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html
imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-firstframe.https.html