Bug 227085 - [macOS WK1] imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-snap-003.html is a flaky failure
Summary: [macOS WK1] imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Scrolling (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-06-16 11:57 PDT by Amir Mark Jr
Modified: 2021-06-23 10:43 PDT (History)
4 users (show)

See Also:


Attachments
Diff (2.26 KB, image/png)
2021-06-16 11:59 PDT, Amir Mark Jr
no flags Details
Actual (17.57 KB, image/png)
2021-06-16 11:59 PDT, Amir Mark Jr
no flags Details
Expected (17.54 KB, image/png)
2021-06-16 12:00 PDT, Amir Mark Jr
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Amir Mark Jr 2021-06-16 11:57:34 PDT
imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-snap-003.html

Is a flaky image failure on BigSur WK1 Debug and Release, and Catalina Wk1 Debug and Release


History:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scroll-snap%2Fscroll-target-snap-003.html


Image Diff:

https://ews-build.s3-us-west-2.amazonaws.com/macOS-Catalina-Debug-WK1-Tests-EWS/r431538-9989/imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-snap-003-diff.png
Comment 1 Radar WebKit Bug Importer 2021-06-16 11:57:57 PDT
<rdar://problem/79409355>
Comment 2 Amir Mark Jr 2021-06-16 11:59:26 PDT
Created attachment 431580 [details]
Diff
Comment 3 Amir Mark Jr 2021-06-16 11:59:46 PDT
Created attachment 431581 [details]
Actual
Comment 4 Amir Mark Jr 2021-06-16 12:00:01 PDT
Created attachment 431582 [details]
Expected
Comment 5 Amir Mark Jr 2021-06-16 12:03:06 PDT
This is also causing slow down in EWS. This test appeared to be consistently failing when introduced but then a change between r278861 and r278862 improved the results of the test and made failure flaky on wk1.
Comment 6 Amir Mark Jr 2021-06-16 12:05:42 PDT
EWS:

https://ews-build.webkit.org/#/builders/56/builds/9986
Comment 7 Amir Mark Jr 2021-06-16 12:14:05 PDT
Updated test expectations: 

https://trac.webkit.org/changeset/278949/webkit
Comment 8 Ryan Haddad 2021-06-16 12:38:17 PDT
Indeed, https://trac.webkit.org/changeset/278862/webkit was a change for css-scroll-snap and removed the failure expectation for this test.

The test says: "Test passes if there is a green stripe across the second quarter of the box below and no red.", and the actual output shows that stripe is red.
Comment 9 Martin Robinson 2021-06-17 01:24:26 PDT
Thanks for updating the expectations here. I hope to find a moment to investigate this flake and other soon.
Comment 10 Amir Mark Jr 2021-06-23 10:43:04 PDT
Updated expectations. Accidentally labeled without ImageOnlyFailure:

https://trac.webkit.org/changeset/279174/webkit