media/video-buffered.html is a flaky failure According to the flakiness Dashboard, the test has been intermittently failing for a long time on all platforms. This doesn't seem to be a recent regression. https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Fvideo-buffered.html https://build.webkit.org/results/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/r218595%20(2415)/results.html https://build.webkit.org/builders/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/builds/2415 diff: --- /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/media/video-buffered-expected.txt +++ /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/media/video-buffered-actual.txt @@ -5,9 +5,9 @@ TEST(video.buffered.start(0)) THROWS(DOMException.INDEX_SIZE_ERR) OK TEST(video.buffered.end(0)) THROWS(DOMException.INDEX_SIZE_ERR) OK EVENT(canplaythrough) -EXPECTED (video.buffered.length == '1') OK -EXPECTED (video.buffered.start(0) == '0') OK -EXPECTED (video.buffered.end(0) > '0') OK +EXPECTED (video.buffered.length == '1'), OBSERVED '0' FAIL +IndexSizeError (DOM Exception 1): The index is not in the allowed range. +IndexSizeError (DOM Exception 1): The index is not in the allowed range. TEST(video.buffered.start(-1)) THROWS(DOMException.INDEX_SIZE_ERR) OK TEST(video.buffered.end(-1)) THROWS(DOMException.INDEX_SIZE_ERR) OK TEST(video.buffered.start(1)) THROWS(DOMException.INDEX_SIZE_ERR) OK
Marked test as flaky on iOS as there already existed test expectations for macOS https://trac.webkit.org/changeset/218605/webkit