Bug 217857 - REGRESSION (r262708): [ Mojave debug wk2 ] imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop.html is a constant failure
Summary: REGRESSION (r262708): [ Mojave debug wk2 ] imported/w3c/web-platform-tests/me...
Status: RESOLVED CONFIGURATION CHANGED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-10-16 16:49 PDT by Karl Rackler
Modified: 2020-10-26 07:51 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Karl Rackler 2020-10-16 16:49:09 PDT
Description:
imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop.html

The first failure in the series of constant failures that I see this on the dashboard was 06/08/20 at r262708. It has to do with using AVAssetWriterDelegate to implement MediaRecorder, which could have introduced the consistent failures. The change was introduced here https://trac.webkit.org/changeset/262708/webkit.

I was unable to reproduce the failure due to the lack of spades in that range.

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-record%2FMediaRecorder-stop.html&limit=50000&version_name=Mojave&flavor=wk2&style=debug

Diff Log:
--- /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop-expected.txt
+++ /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop-actual.txt
@@ -1,9 +1,9 @@
 
-PASS MediaRecorder will stop recording and fire a stop event when all tracks are ended
-PASS MediaRecorder will stop recording and fire a stop event when stop() is called
+FAIL MediaRecorder will stop recording and fire a stop event when all tracks are ended promise_test: Unhandled rejection with value: object "NotSupportedError: The MediaRecorder is unsupported on this platform"
+FAIL MediaRecorder will stop recording and fire a stop event when stop() is called promise_test: Unhandled rejection with value: object "NotSupportedError: The MediaRecorder is unsupported on this platform"
 PASS MediaRecorder will not fire an exception when stopped after creation
-PASS MediaRecorder will not fire an exception when stopped after having just been stopped
-PASS MediaRecorder will not fire an exception when stopped after having just been spontaneously stopped
-PASS MediaRecorder will fire start event even if stopped synchronously
-PASS MediaRecorder will fire start event even if a track is removed synchronously
+FAIL MediaRecorder will not fire an exception when stopped after having just been stopped promise_test: Unhandled rejection with value: object "NotSupportedError: The MediaRecorder is unsupported on this platform"
+FAIL MediaRecorder will not fire an exception when stopped after having just been spontaneously stopped promise_test: Unhandled rejection with value: object "NotSupportedError: The MediaRecorder is unsupported on this platform"
+FAIL MediaRecorder will fire start event even if stopped synchronously promise_test: Unhandled rejection with value: object "NotSupportedError: The MediaRecorder is unsupported on this platform"
+FAIL MediaRecorder will fire start event even if a track is removed synchronously promise_test: Unhandled rejection with value: object "NotSupportedError: The MediaRecorder is unsupported on this platform"
Comment 1 Radar WebKit Bug Importer 2020-10-16 16:49:34 PDT
<rdar://problem/70397075>
Comment 2 Karl Rackler 2020-10-16 17:07:47 PDT
I have marked this test as skip while this issue is investigated.
https://trac.webkit.org/changeset/268621/webkit
Comment 3 youenn fablet 2020-10-26 03:39:15 PDT
MediaRecorder is not supported in Mojave, so we just need to rebase the test expectation or skip it.
We skip all media recorder tests for Mojave by default but this might be overridden by other expectation lines.
Karl expectation update seems fine to me.
Comment 4 Karl Rackler 2020-10-26 07:51:25 PDT
(In reply to youenn fablet from comment #3)
> MediaRecorder is not supported in Mojave, so we just need to rebase the test
> expectation or skip it.
> We skip all media recorder tests for Mojave by default but this might be
> overridden by other expectation lines.
> Karl expectation update seems fine to me.

Thank you Youenn.
Verified test should be skipped for Mojave and leaving test expectation in place.