Bug 187911 - [macOS debug] Layout Test imported/w3c/web-platform-tests/media-source/SourceBuffer-abort-readyState.html is a flaky failure
Summary: [macOS debug] Layout Test imported/w3c/web-platform-tests/media-source/Source...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: Other
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2018-07-23 10:43 PDT by Ryan Haddad
Modified: 2020-04-08 13:05 PDT (History)
8 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2018-07-23 10:43:53 PDT
The following layout test is flaky on macOS debug bots

imported/w3c/web-platform-tests/media-source/SourceBuffer-abort-readyState.html

Probable cause:

Unknown, this test has been flaky for a while.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2FSourceBuffer-abort-readyState.html

The test usually completes less than 2 seconds, but intermittently times out after 135 seconds with the following diff:

--- /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/media-source/SourceBuffer-abort-readyState-expected.txt
+++ /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/media-source/SourceBuffer-abort-readyState-actual.txt
@@ -1,4 +1,7 @@
+CONSOLE MESSAGE: line 51: InvalidStateError: The object is in an invalid state.
+
+Harness Error (FAIL), message = InvalidStateError: The object is in an invalid state.
 
 FAIL SourceBuffer#abort() (video/webm; codecs="vorbis,vp8") : If the readyState attribute of the parent media source is not in the "open" state then throw an INVALID_STATE_ERR exception and abort these steps. assert_unreached: Browser doesn't support the MIME used in this test: video/webm; codecs="vorbis,vp8" Reached unreachable code
-PASS SourceBuffer#abort() (video/mp4) : If the readyState attribute of the parent media source is not in the "open" state then throw an INVALID_STATE_ERR exception and abort these steps. 
+TIMEOUT SourceBuffer#abort() (video/mp4) : If the readyState attribute of the parent media source is not in the "open" state then throw an INVALID_STATE_ERR exception and abort these steps. Test timed out
Comment 1 Truitt Savell 2018-08-30 16:56:02 PDT
Issue still occurring. 

easily can reproduce issue with a debug build and running with:

run-webkit-tests --root debug-235460 imported/w3c/web-platform-tests/media-source/SourceBuffer-abort-readyState.html --iterations 500 -f --debug
Comment 2 Radar WebKit Bug Importer 2020-04-08 12:54:56 PDT
<rdar://problem/61471458>
Comment 3 Jacob Uphoff 2020-04-08 12:55:20 PDT
Test is still flaky failing.
Comment 4 Jacob Uphoff 2020-04-08 13:05:51 PDT
Set expectations for this here: https://trac.webkit.org/changeset/259749/webkit