[ Mac wk2 ] imported/w3c/web-platform-tests/mediacapture-streams/MediaStream tests are flaky failing.
https://bugs.webkit.org/show_bug.cgi?id=209148
Summary [ Mac wk2 ] imported/w3c/web-platform-tests/mediacapture-streams/MediaStream ...
Jason Lawrence
Reported 2020-03-16 13:47:19 PDT
imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-srcObject.https.html imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html Description: These tests are flaky failing on Mac wk2. The tests started flaky failing in the first week of March. History: https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-streams%2FMediaStream-MediaElement-srcObject.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-streams%2FMediaStream-removetrack.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-streams%2FMediaStream-removetrack.https.html&platform=mac&limit=50000#recent=false Diff: --- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-firstframe.https-expected.txt +++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-firstframe.https-actual.txt @@ -6,6 +6,6 @@ -PASS Tests that loading a MediaStream in a media element eventually results in "canplay" even when not playing or autoplaying -PASS Tests that loading a MediaStream in a media element sees all the expected (deterministic) events even when not playing or autoplaying +FAIL Tests that loading a MediaStream in a media element eventually results in "canplay" even when not playing or autoplaying promise_test: Unhandled rejection with value: object "Error: canplay timeout" +FAIL Tests that loading a MediaStream in a media element sees all the expected (deterministic) events even when not playing or autoplaying promise_test: Unhandled rejection with value: object "Error: durationchange timeout" Diff: --- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-srcObject.https-expected.txt +++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-srcObject.https-actual.txt @@ -10,8 +10,8 @@ PASS Tests that a MediaStream can be assigned to a video element with srcObject PASS Tests that a MediaStream assigned to a video element is not seekable -PASS Tests that a MediaStream assigned to a video element is in readyState HAVE_NOTHING initially -TIMEOUT Tests that a MediaStream assigned to a video element has expected duration Test timed out +TIMEOUT Tests that a MediaStream assigned to a video element is in readyState HAVE_NOTHING initially Test timed out +NOTRUN Tests that a MediaStream assigned to a video element has expected duration NOTRUN Tests that a video element with a MediaStream assigned is not preloaded NOTRUN Tests that a video element with a MediaStream assigned ignores playbackRate attributes (defaultPlaybackRate is identical) NOTRUN Tests that a video element with a MediaStream assigned ignores playbackRate attributes (defaultPlaybackRate is different) Diff: --- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https-expected.txt +++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https-actual.txt @@ -6,7 +6,9 @@ +Harness Error (TIMEOUT), message = null + PASS Tests that a removal from a MediaStream works as expected -PASS Test that removal from a MediaStream fires ended on media elements (video first) -FAIL Test that removal from a MediaStream fires ended on media elements (audio first) assert_equals: audio element ended because no more audio tracks expected true but got false +TIMEOUT Test that removal from a MediaStream fires ended on media elements (video first) Test timed out +NOTRUN Test that removal from a MediaStream fires ended on media elements (audio first)
Attachments
Radar WebKit Bug Importer
Comment 1 2020-03-16 13:47:49 PDT
Jason Lawrence
Comment 2 2020-03-16 13:56:24 PDT
I have marked the three tests as failing while this issue is investigated. https://trac.webkit.org/changeset/258517/webkit imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-srcObject.https.html imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-MediaElement-firstframe.https.html
Note You need to log in before you can comment on or make changes to this bug.