Bug 173611 - Layout Test media/video-buffered.html is flaky
Summary: Layout Test media/video-buffered.html is flaky
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-06-20 11:42 PDT by Matt Lewis
Modified: 2017-06-20 11:58 PDT (History)
1 user (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Matt Lewis 2017-06-20 11:42:12 PDT
media/video-buffered.html is a flaky failure
According to the flakiness Dashboard, the test has been intermittently failing for a long time on all platforms. This doesn't seem to be a recent regression.
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Fvideo-buffered.html

https://build.webkit.org/results/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/r218595%20(2415)/results.html
https://build.webkit.org/builders/Apple%20iOS%2010%20Simulator%20Release%20WK2%20(Tests)/builds/2415

diff:
--- /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/media/video-buffered-expected.txt
+++ /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/media/video-buffered-actual.txt
@@ -5,9 +5,9 @@
 TEST(video.buffered.start(0)) THROWS(DOMException.INDEX_SIZE_ERR) OK
 TEST(video.buffered.end(0)) THROWS(DOMException.INDEX_SIZE_ERR) OK
 EVENT(canplaythrough)
-EXPECTED (video.buffered.length == '1') OK
-EXPECTED (video.buffered.start(0) == '0') OK
-EXPECTED (video.buffered.end(0) > '0') OK
+EXPECTED (video.buffered.length == '1'), OBSERVED '0' FAIL
+IndexSizeError (DOM Exception 1): The index is not in the allowed range.
+IndexSizeError (DOM Exception 1): The index is not in the allowed range.
 TEST(video.buffered.start(-1)) THROWS(DOMException.INDEX_SIZE_ERR) OK
 TEST(video.buffered.end(-1)) THROWS(DOMException.INDEX_SIZE_ERR) OK
 TEST(video.buffered.start(1)) THROWS(DOMException.INDEX_SIZE_ERR) OK
Comment 1 Matt Lewis 2017-06-20 11:58:19 PDT
Marked test as flaky on iOS as there already existed test expectations for macOS
https://trac.webkit.org/changeset/218605/webkit