Bug 158320 - LayoutTest tiled-drawing/scrolling/latched-div-with-scroll-snap.html is flaky
Summary: LayoutTest tiled-drawing/scrolling/latched-div-with-scroll-snap.html is flaky
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: zalan
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2016-06-02 15:22 PDT by Ryan Haddad
Modified: 2016-06-21 16:32 PDT (History)
6 users (show)

See Also:


Attachments
Patch (7.34 KB, patch)
2016-06-21 13:40 PDT, zalan
no flags Details | Formatted Diff | Diff
Patch (7.85 KB, patch)
2016-06-21 15:25 PDT, zalan
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2016-06-02 15:22:08 PDT
LayoutTest tiled-drawing/scrolling/latched-div-with-scroll-snap.html is flaky

This test is frequently failing or timing out on mac-wk2. It has been flaky for a while, but as of 5/28/16 it fails much more frequently.

Most recent failure:
<https://build.webkit.org/builders/Apple%20El%20Capitan%20Debug%20WK2%20(Tests)/builds/5581>

<https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=tiled-drawing%2Fscrolling%2Flatched-div-with-scroll-snap.html>

--- /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/tiled-drawing/scrolling/latched-div-with-scroll-snap-expected.txt
+++ /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/tiled-drawing/scrolling/latched-div-with-scroll-snap-actual.txt
@@ -3,7 +3,7 @@
 PASS div honored snap points.
 Testing that latch moves to bottom div:
 PASS top div did not move.
-PASS div scrolled to next window.
+FAIL div did not honor snap points. Expected 200, but got 50
 PASS successfullyParsed is true
 
 TEST COMPLETE
Comment 1 Ryan Haddad 2016-06-06 15:07:55 PDT
El Capitan only, seems to fail 100% of the time

https://build.webkit.org/builders/Apple%20El%20Capitan%2032-bit%20JSC%20(BuildAndTest)?numbuilds=50
Comment 2 Ryan Haddad 2016-06-07 09:36:57 PDT
(In reply to comment #1)
> El Capitan only, seems to fail 100% of the time
> 
> https://build.webkit.org/builders/Apple%20El%20Capitan%2032-
> bit%20JSC%20(BuildAndTest)?numbuilds=50

This comment was intended for a different bug. Please disregard.

However, tiled-drawing/scrolling/latched-div-with-scroll-snap.html is still frequently failing or timing out on Mac, especially on El Capitan Debug WK2
Comment 3 Brent Fulgham 2016-06-07 09:45:23 PDT
(In reply to comment #2)
> (In reply to comment #1)
> > El Capitan only, seems to fail 100% of the time
> > 
> > https://build.webkit.org/builders/Apple%20El%20Capitan%2032-
> > bit%20JSC%20(BuildAndTest)?numbuilds=50
> 
> This comment was intended for a different bug. Please disregard.
> 
> However, tiled-drawing/scrolling/latched-div-with-scroll-snap.html is still
> frequently failing or timing out on Mac, especially on El Capitan Debug WK2

We have general flakiness in a lot of these scroll-snap/latching tests. Much of this is due to generating 'fake' wheel gestures to drive the tests. Maybe some partial event state is getting held over from test-to-test and causing things to behave in weird ways.

Simon and I spent a lot of time trying to get this more stable, but clearly more effort is needed.
Comment 4 Alexey Proskuryakov 2016-06-11 22:21:41 PDT
> It has been flaky for a while, but as of 5/28/16 it fails much more frequently.

Is there any way to more precisely isolate when this started?

There were sweeping changes to callOnMainThread and NoncopyableFunction on 5/28 and 5/27, and while I don't see anything wrong with those patches, a mistake there could easily cause such symptoms.
Comment 5 Alexey Proskuryakov 2016-06-11 22:31:28 PDT
It started early on 5/28, roughly around 1am. <http://trac.webkit.org/projects/webkit/changeset/201482> seems to fit.
Comment 6 Alexey Proskuryakov 2016-06-11 22:34:50 PDT
Or looking at revision numbers and not at times, <http://trac.webkit.org/projects/webkit/changeset/201476>.
Comment 7 Alexey Proskuryakov 2016-06-20 23:09:09 PDT
Marked as flaky in <http://trac.webkit.org/r202269>.

Zalan, do you think that you could look into this?
Comment 8 zalan 2016-06-21 13:40:56 PDT
Created attachment 281771 [details]
Patch
Comment 9 Alexey Proskuryakov 2016-06-21 13:43:51 PDT
Comment on attachment 281771 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=281771&action=review

r=me pending EWS

> LayoutTests/tiled-drawing/scrolling/latched-div-with-scroll-snap.html:30
> -        <script src="../../resources/js-test.js"></script>
> +        <script src="../../resources/js-test-pre.js"></script>

Why this change? I think that js-test.js is slightly preferable in general.
Comment 10 Alexey Proskuryakov 2016-06-21 13:44:48 PDT
Comment on attachment 281771 [details]
Patch

Please remove the test from TestExpectations, now that it's expected to pass reliably.
Comment 11 zalan 2016-06-21 15:25:32 PDT
Created attachment 281787 [details]
Patch
Comment 12 WebKit Commit Bot 2016-06-21 16:32:45 PDT
Comment on attachment 281787 [details]
Patch

Clearing flags on attachment: 281787

Committed r202304: <http://trac.webkit.org/changeset/202304>
Comment 13 WebKit Commit Bot 2016-06-21 16:32:50 PDT
All reviewed patches have been landed.  Closing bug.