Bug 227085 – [macOS WK1] imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-snap-003.html is a flaky failure

• Status: NEW
• Component: Scrolling

[Amir Mark Jr]

imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-snap-003.html

Is a flaky image failure on BigSur WK1 Debug and Release, and Catalina Wk1 Debug and Release


History:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scroll-snap%2Fscroll-target-snap-003.html


Image Diff:

https://ews-build.s3-us-west-2.amazonaws.com/macOS-Catalina-Debug-WK1-Tests-EWS/r431538-9989/imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-snap-003-diff.png

[Radar WebKit Bug Importer]

<rdar://problem/79409355>

[Amir Mark Jr]

Created attachment 431580 [details]
Diff

[Amir Mark Jr]

Created attachment 431581 [details]
Actual

[Amir Mark Jr]

Created attachment 431582 [details]
Expected

[Amir Mark Jr]

This is also causing slow down in EWS. This test appeared to be consistently failing when introduced but then a change between r278861 and r278862 improved the results of the test and made failure flaky on wk1.

[Amir Mark Jr]

EWS:

https://ews-build.webkit.org/#/builders/56/builds/9986

[Amir Mark Jr]

Updated test expectations: 

https://trac.webkit.org/changeset/278949/webkit

[Ryan Haddad]

Indeed, https://trac.webkit.org/changeset/278862/webkit was a change for css-scroll-snap and removed the failure expectation for this test.

The test says: "Test passes if there is a green stripe across the second quarter of the box below and no red.", and the actual output shows that stripe is red.

[Martin Robinson]

Thanks for updating the expectations here. I hope to find a moment to investigate this flake and other soon.

[Amir Mark Jr]

Updated expectations. Accidentally labeled without ImageOnlyFailure:

https://trac.webkit.org/changeset/279174/webkit