Bug 227085

Summary: [macOS WK1] imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-snap-003.html is a flaky failure
Product: WebKit Reporter: Amir Mark Jr <amir_mark>
Component: ScrollingAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: mrobinson, simon.fraser, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=226630
Attachments:
Description Flags
Diff
none
Actual
none
Expected none

Description Amir Mark Jr 2021-06-16 11:57:34 PDT 
imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-snap-003.html

Is a flaky image failure on BigSur WK1 Debug and Release, and Catalina Wk1 Debug and Release


History:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scroll-snap%2Fscroll-target-snap-003.html


Image Diff:

https://ews-build.s3-us-west-2.amazonaws.com/macOS-Catalina-Debug-WK1-Tests-EWS/r431538-9989/imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-snap-003-diff.png
Comment 1 Radar WebKit Bug Importer 2021-06-16 11:57:57 PDT 
<rdar://problem/79409355>
Comment 2 Amir Mark Jr 2021-06-16 11:59:26 PDT 
Created attachment 431580 [details]
Diff
Comment 3 Amir Mark Jr 2021-06-16 11:59:46 PDT 
Created attachment 431581 [details]
Actual
Comment 4 Amir Mark Jr 2021-06-16 12:00:01 PDT 
Created attachment 431582 [details]
Expected
Comment 5 Amir Mark Jr 2021-06-16 12:03:06 PDT 
This is also causing slow down in EWS. This test appeared to be consistently failing when introduced but then a change between r278861 and r278862 improved the results of the test and made failure flaky on wk1.
Comment 6 Amir Mark Jr 2021-06-16 12:05:42 PDT 
EWS:

https://ews-build.webkit.org/#/builders/56/builds/9986
Comment 7 Amir Mark Jr 2021-06-16 12:14:05 PDT 
Updated test expectations: 

https://trac.webkit.org/changeset/278949/webkit
Comment 8 Ryan Haddad 2021-06-16 12:38:17 PDT 
Indeed, https://trac.webkit.org/changeset/278862/webkit was a change for css-scroll-snap and removed the failure expectation for this test.

The test says: "Test passes if there is a green stripe across the second quarter of the box below and no red.", and the actual output shows that stripe is red.
Comment 9 Martin Robinson 2021-06-17 01:24:26 PDT 
Thanks for updating the expectations here. I hope to find a moment to investigate this flake and other soon.
Comment 10 Amir Mark Jr 2021-06-23 10:43:04 PDT 
Updated expectations. Accidentally labeled without ImageOnlyFailure:

https://trac.webkit.org/changeset/279174/webkit