Bug 173608 - Layout Test webrtc/video-replace-muted-track.html is flaky
Summary: Layout Test webrtc/video-replace-muted-track.html is flaky
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
Keywords: InRadar
Depends on:
Reported: 2017-06-20 11:27 PDT by Matt Lewis
Modified: 2020-02-19 08:52 PST (History)
3 users (show)

See Also:


Note You need to log in before you can comment on or make changes to this bug.
Description Matt Lewis 2017-06-20 11:27:56 PDT
webrtc/video-replace-muted-track.html is a flaky failure on iOS simulator according to the flakiness Dashboard.


It was added in r218426 and looks to have been flaky since being added.


--- /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/video-replace-muted-track-expected.txt
+++ /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/video-replace-muted-track-actual.txt
@@ -1,3 +1,3 @@
-PASS Switching from disabled to enabled track 
+FAIL Switching from disabled to enabled track assert_unreached: Reached unreachable code
Comment 1 Matt Lewis 2017-06-20 17:03:30 PDT
Marked test as flaky on iOS WK2:
Comment 2 Radar WebKit Bug Importer 2017-06-22 14:02:52 PDT
Comment 3 Matt Lewis 2017-06-22 14:17:22 PDT
This test has started to fail on Sierra WK2 and El Capitan WK2 Release.

On iOS the test fails far more than passes.

Comment 4 Matt Lewis 2017-06-23 15:51:58 PDT
Updated test expectations:
Comment 5 Matt Lewis 2017-06-27 14:33:01 PDT
As of this build and revision the Test has stopped failing on iOS Simulator debug, but has started to timeout at 35 seconds.

Comment 6 Ryan Haddad 2017-06-28 14:23:27 PDT
Skipped test on iOS in https://trac.webkit.org/changeset/218893
Comment 7 Matt Lewis 2017-07-07 13:39:38 PDT
Adjusted test expectations:
Comment 8 Matt Lewis 2017-10-26 11:08:38 PDT
This test had expectations removed in https://trac.webkit.org/changeset/222273/webkit however the test is still exhibiting the flaky timeout.

Comment 9 youenn fablet 2017-10-26 11:15:36 PDT
Looking at the dashboard, tests sometimes time out for HighSierra and iOS simulator, Release/Debug.
They do not time out for Sierra and ElCapitan.
I wonder whether the difference is OS related or bot-setup related.
Comment 10 Matt Lewis 2017-10-26 11:17:52 PDT
Skipped in https://trac.webkit.org/changeset/224028/webkit