[ macOS wk2 ] fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html (layout-test) is a flaky Image failure
https://bugs.webkit.org/show_bug.cgi?id=225498
Summary [ macOS wk2 ] fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html (l...
Robert Jenner
Reported 2021-05-06 17:34:35 PDT
fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html is a flaky image failure on macOS wk 2. The failure mostly occurs on BigSur running on Apple Silicon Macs. However, it has also failed twice on Intel Macs running Catalina. HISTORY: https://results.webkit.org/?suite=layout-tests&test=fast%2Fscrolling%2Fmac%2Foverflow-scrollbars-toggle-dark-mode.html IMAGE DIFF URL: https://build.webkit.org/results/Apple-BigSur-Release-AppleSilicon-WK2-Tests/r277080%20(1316)/fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode-diffs.html I have attached the images to this bug below.
Attachments
Diff files for image failures (5.86 KB, application/zip)
2021-05-06 17:36 PDT, Robert Jenner
no flags
Robert Jenner
Comment 1 2021-05-06 17:36:00 PDT
Created attachment 427965 [details] Diff files for image failures Attaching diff images to bug.
Robert Jenner
Comment 2 2021-05-06 17:42:23 PDT
I don't have access to an Apple Silicon Mac, so I can't reproduce in that environment. However, I was able to reproduce the failure on an Intel Mac running Catalina Debug ToT using the following test: run-webkit-tests fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html --iterations 1000 -f I was also able to reproduce the failure over 5,600 revisions back. So this appears to have been a flaky failure for a while.
Robert Jenner
Comment 3 2021-05-06 17:57:42 PDT
Updated test expectations here to flaky ( Pass ImageOnlyFailure ) here: https://trac.webkit.org/changeset/277146/webkit
Radar WebKit Bug Importer
Comment 4 2021-05-06 17:58:29 PDT
Note You need to log in before you can comment on or make changes to this bug.