Bug 161491 - [WK2] LayoutTest media/video-main-content-allow-then-scroll.html is a flaky failure
Summary: [WK2] LayoutTest media/video-main-content-allow-then-scroll.html is a flaky f...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Media (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2016-09-01 10:32 PDT by Ryan Haddad
Modified: 2017-09-06 16:33 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2016-09-01 10:32:40 PDT
LayoutTest media/video-main-content-allow-then-scroll.html is a flaky failure

This test is a flaky failure on ios-simulator-wk2

https://build.webkit.org/builders/Apple%20iOS%209%20Simulator%20Debug%20WK2%20(Tests)/builds/4887

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Fvideo-main-content-allow-then-scroll.html

--- /Volumes/Data/slave/ios-simulator-9-debug-tests-wk2/build/layout-test-results/media/video-main-content-allow-then-scroll-expected.txt
+++ /Volumes/Data/slave/ios-simulator-9-debug-tests-wk2/build/layout-test-results/media/video-main-content-allow-then-scroll-actual.txt
@@ -2,7 +2,7 @@
 EVENT(canplaythrough)
 EVENT(playing)
 RUN(document.body.scrollTop = document.body.clientHeight)
-EXPECTED (video.paused == 'false') OK
+EVENT(pause) TEST(false) FAIL
 END OF TEST
Comment 1 Ryan Haddad 2016-09-01 10:40:48 PDT
Marked test as flaky in http://trac.webkit.org/projects/webkit/changeset/205296
Comment 2 Matt Lewis 2017-09-05 13:20:40 PDT
This test has since started to be flaky on macOS and consistently fail on iOS according the the dashboard.

The first macOS build with a failure was:

https://build.webkit.org/builders/Apple%20Sierra%20Debug%20WK1%20(Tests)/builds/2992
https://build.webkit.org/results/Apple%20Sierra%20Debug%20WK1%20(Tests)/r220715%20(2992)/results.html

The macOS Diff:
--- /Volumes/Data/slave/sierra-debug-tests-wk1/build/layout-test-results/media/video-main-content-allow-then-scroll-expected.txt
+++ /Volumes/Data/slave/sierra-debug-tests-wk1/build/layout-test-results/media/video-main-content-allow-then-scroll-actual.txt
@@ -2,7 +2,7 @@
 EVENT(canplaythrough)
 EVENT(playing)
 RUN(document.body.scrollTop = document.body.clientHeight)
-EXPECTED (video.paused == 'false') OK
+EXPECTED (video.paused == 'false'), OBSERVED 'true' FAIL
 END OF TEST
Comment 3 Matt Lewis 2017-09-06 16:33:56 PDT
Marked test as flaky on Mac and failing on iOS:
https://trac.webkit.org/changeset/221708/webkit