Bug 227085

Summary: [macOS WK1] imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-snap-003.html is a flaky failure
Product: WebKit Reporter: Amir Mark Jr <amir_mark>
Component: ScrollingAssignee: Nobody <webkit-unassigned>
Status: NEW    
Severity: Normal CC: mrobinson, simon.fraser, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=226630
Attachments:
Description Flags
Diff
none
Actual
none
Expected none

Amir Mark Jr
Reported 2021-06-16 11:57:34 PDT
imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-snap-003.html Is a flaky image failure on BigSur WK1 Debug and Release, and Catalina Wk1 Debug and Release History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scroll-snap%2Fscroll-target-snap-003.html Image Diff: https://ews-build.s3-us-west-2.amazonaws.com/macOS-Catalina-Debug-WK1-Tests-EWS/r431538-9989/imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-snap-003-diff.png
Attachments
Diff (2.26 KB, image/png)
2021-06-16 11:59 PDT, Amir Mark Jr 		no flags
Details
Actual (17.57 KB, image/png)
2021-06-16 11:59 PDT, Amir Mark Jr 		no flags
Details
Expected (17.54 KB, image/png)
2021-06-16 12:00 PDT, Amir Mark Jr 		no flags
Details
View All Add attachment proposed patch, testcase, etc.
Radar WebKit Bug Importer
Comment 1 2021-06-16 11:57:57 PDT
<rdar://problem/79409355>
Amir Mark Jr
Comment 2 2021-06-16 11:59:26 PDT
Created attachment 431580 [details] Diff
Amir Mark Jr
Comment 3 2021-06-16 11:59:46 PDT
Created attachment 431581 [details] Actual
Amir Mark Jr
Comment 4 2021-06-16 12:00:01 PDT
Created attachment 431582 [details] Expected
Amir Mark Jr
Comment 5 2021-06-16 12:03:06 PDT
This is also causing slow down in EWS. This test appeared to be consistently failing when introduced but then a change between r278861 and r278862 improved the results of the test and made failure flaky on wk1.
Amir Mark Jr
Comment 6 2021-06-16 12:05:42 PDT
EWS: https://ews-build.webkit.org/#/builders/56/builds/9986
Amir Mark Jr
Comment 7 2021-06-16 12:14:05 PDT
Updated test expectations: https://trac.webkit.org/changeset/278949/webkit
Ryan Haddad
Comment 8 2021-06-16 12:38:17 PDT
Indeed, https://trac.webkit.org/changeset/278862/webkit was a change for css-scroll-snap and removed the failure expectation for this test. The test says: "Test passes if there is a green stripe across the second quarter of the box below and no red.", and the actual output shows that stripe is red.
Martin Robinson
Comment 9 2021-06-17 01:24:26 PDT
Thanks for updating the expectations here. I hope to find a moment to investigate this flake and other soon.
Amir Mark Jr
Comment 10 2021-06-23 10:43:04 PDT
Updated expectations. Accidentally labeled without ImageOnlyFailure: https://trac.webkit.org/changeset/279174/webkit
Note You need to log in before you can comment on or make changes to this bug.