Bug 225498 – [ macOS wk2 ] fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html (layout-test) is a flaky Image failure

• Component: New Bugs
• Status: NEW

[Robert Jenner]

fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html

is a flaky image failure on macOS wk 2. The failure mostly occurs on BigSur running on Apple Silicon Macs. However, it has also failed twice on Intel Macs running Catalina. 

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=fast%2Fscrolling%2Fmac%2Foverflow-scrollbars-toggle-dark-mode.html

IMAGE DIFF URL:
https://build.webkit.org/results/Apple-BigSur-Release-AppleSilicon-WK2-Tests/r277080%20(1316)/fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode-diffs.html

I have attached the images to this bug below.

[Robert Jenner]

Created attachment 427965 [details]
Diff files for image failures

Attaching diff images to bug.

[Robert Jenner]

I don't have access to an Apple Silicon Mac, so I can't reproduce in that environment. However, I was able to reproduce the failure on an Intel Mac running Catalina Debug ToT using the following test:

run-webkit-tests fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html --iterations 1000 -f 


I was also able to reproduce the failure over 5,600 revisions back. So this appears to have been a flaky failure for a while.

[Robert Jenner]

Updated test expectations here to flaky ( Pass ImageOnlyFailure ) here:
https://trac.webkit.org/changeset/277146/webkit

[Radar WebKit Bug Importer]

<rdar://problem/77634423>