173608 2017-06-20 11:27:56 -0700 Layout Test webrtc/video-replace-muted-track.html is flaky 2020-02-19 08:52:07 -0800 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified NEW https://bugs.webkit.org/show_bug.cgi?id=173486 https://bugs.webkit.org/show_bug.cgi?id=207941 InRadar P2 Normal --- 1 jlewis3 webkit-unassigned ryanhaddad webkit-bug-importer youennf oldest_to_newest 1321171 0 jlewis3 2017-06-20 11:27:56 -0700 webrtc/video-replace-muted-track.html is a flaky failure on iOS simulator according to the flakiness Dashboard. https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=webrtc%2Fvideo-replace-muted-track.html It was added in r218426 and looks to have been flaky since being added. https://trac.webkit.org/changeset/218426/webkit https://build.webkit.org/results/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/r218595%20(2415)/results.html https://build.webkit.org/builders/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/builds/2415 Diff: --- /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/video-replace-muted-track-expected.txt +++ /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/video-replace-muted-track-actual.txt @@ -1,3 +1,3 @@ -PASS Switching from disabled to enabled track +FAIL Switching from disabled to enabled track assert_unreached: Reached unreachable code 1321304 1 jlewis3 2017-06-20 17:03:30 -0700 Marked test as flaky on iOS WK2: https://trac.webkit.org/changeset/218617/webkit 1322038 2 webkit-bug-importer 2017-06-22 14:02:52 -0700 <rdar://problem/32932337> 1322054 3 jlewis3 2017-06-22 14:17:22 -0700 This test has started to fail on Sierra WK2 and El Capitan WK2 Release. On iOS the test fails far more than passes. https://build.webkit.org/results/Apple%20Sierra%20Debug%20WK2%20(Tests)/r218708%20(1699)/results.html https://build.webkit.org/builders/Apple%20Sierra%20Debug%20WK2%20(Tests)/builds/1699 1322480 4 jlewis3 2017-06-23 15:51:58 -0700 Updated test expectations: https://trac.webkit.org/changeset/218770/webkit 1323260 5 jlewis3 2017-06-27 14:33:01 -0700 As of this build and revision the Test has stopped failing on iOS Simulator debug, but has started to timeout at 35 seconds. https://trac.webkit.org/changeset/218795/webkit https://build.webkit.org/builders/Apple%20iOS%2010%20Simulator%20Debug%20WK2%20(Tests)/builds/2325 1323674 6 ryanhaddad 2017-06-28 14:23:27 -0700 Skipped test on iOS in https://trac.webkit.org/changeset/218893 1326596 7 jlewis3 2017-07-07 13:39:38 -0700 Adjusted test expectations: https://trac.webkit.org/changeset/219267/webkit 1364919 8 jlewis3 2017-10-26 11:08:38 -0700 This test had expectations removed in https://trac.webkit.org/changeset/222273/webkit however the test is still exhibiting the flaky timeout. https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#tests=webrtc%2Fvideo-replace-muted-track.html 1364925 9 youennf 2017-10-26 11:15:36 -0700 Looking at the dashboard, tests sometimes time out for HighSierra and iOS simulator, Release/Debug. They do not time out for Sierra and ElCapitan. I wonder whether the difference is OS related or bot-setup related. 1364926 10 jlewis3 2017-10-26 11:17:52 -0700 Skipped in https://trac.webkit.org/changeset/224028/webkit