webrtc/video-replace-muted-track.html is a flaky failure on iOS simulator according to the flakiness Dashboard. https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=webrtc%2Fvideo-replace-muted-track.html It was added in r218426 and looks to have been flaky since being added. https://trac.webkit.org/changeset/218426/webkit https://build.webkit.org/results/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/r218595%20(2415)/results.html https://build.webkit.org/builders/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/builds/2415 Diff: --- /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/video-replace-muted-track-expected.txt +++ /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/video-replace-muted-track-actual.txt @@ -1,3 +1,3 @@ -PASS Switching from disabled to enabled track +FAIL Switching from disabled to enabled track assert_unreached: Reached unreachable code
Marked test as flaky on iOS WK2: https://trac.webkit.org/changeset/218617/webkit
<rdar://problem/32932337>
This test has started to fail on Sierra WK2 and El Capitan WK2 Release. On iOS the test fails far more than passes. https://build.webkit.org/results/Apple%20Sierra%20Debug%20WK2%20(Tests)/r218708%20(1699)/results.html https://build.webkit.org/builders/Apple%20Sierra%20Debug%20WK2%20(Tests)/builds/1699
Updated test expectations: https://trac.webkit.org/changeset/218770/webkit
As of this build and revision the Test has stopped failing on iOS Simulator debug, but has started to timeout at 35 seconds. https://trac.webkit.org/changeset/218795/webkit https://build.webkit.org/builders/Apple%20iOS%2010%20Simulator%20Debug%20WK2%20(Tests)/builds/2325
Skipped test on iOS in https://trac.webkit.org/changeset/218893
Adjusted test expectations: https://trac.webkit.org/changeset/219267/webkit
This test had expectations removed in https://trac.webkit.org/changeset/222273/webkit however the test is still exhibiting the flaky timeout. https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#tests=webrtc%2Fvideo-replace-muted-track.html
Looking at the dashboard, tests sometimes time out for HighSierra and iOS simulator, Release/Debug. They do not time out for Sierra and ElCapitan. I wonder whether the difference is OS related or bot-setup related.
Skipped in https://trac.webkit.org/changeset/224028/webkit