Bug 196403

Summary: [ Mac WK2 iOS Sim ] Layout Test imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop.html is a flaky failure
Product: WebKit Reporter: Shawn Roberts <sroberts>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: ap, cdumez, hector_i_lopez, lforschler, webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=190778
https://bugs.webkit.org/show_bug.cgi?id=190642

Description Shawn Roberts 2019-03-29 11:59:20 PDT
The following layout test is failing on Mac WK2 Release and Debug, iOS Simulator Release and Debug

imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop.html

Probable cause:

Test has been flaky its entire history on the dashboard. Local testing fails on on various versions from when the test was imported in https://trac.webkit.org/changeset/237311/webkit and reported flaky then.

Test was modified and fixed in https://trac.webkit.org/changeset/237642/webkit and reported flaky then as well.

Test recently started showing up in iOS queue's, but testing with older revisions for iOS up until r237642 fail as well.

Fails on average 2 times in 500 iterations.

Reproduced with :

run-webkit-tests imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop.html --iterations 500 -f

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-record%2FMediaRecorder-stop.html

Diff:

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop-actual.txt
@@ -1,4 +1,6 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS MediaRecorder will stop recording and fire a stop event when all tracks are ended 
-PASS MediaRecorder will stop recording and fire a stop event when stop() is called 
+TIMEOUT MediaRecorder will stop recording and fire a stop event when stop() is called Test timed out
Comment 1 Radar WebKit Bug Importer 2019-03-29 12:00:28 PDT
<rdar://problem/49429677>
Comment 2 Shawn Roberts 2019-03-29 13:24:23 PDT
Marked flaky in https://trac.webkit.org/changeset/243659/webkit
Comment 3 youenn fablet 2020-12-18 05:59:18 PST
*** Bug 217538 has been marked as a duplicate of this bug. ***