Bug 225498 - [ macOS wk2 ] fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html (layout-test) is a flaky Image failure
Summary: [ macOS wk2 ] fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html (l...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-05-06 17:34 PDT by Robert Jenner
Modified: 2021-05-06 18:00 PDT (History)
3 users (show)

See Also:


Attachments
Diff files for image failures (5.86 KB, application/zip)
2021-05-06 17:36 PDT, Robert Jenner
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2021-05-06 17:34:35 PDT
fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html

is a flaky image failure on macOS wk 2. The failure mostly occurs on BigSur running on Apple Silicon Macs. However, it has also failed twice on Intel Macs running Catalina. 

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=fast%2Fscrolling%2Fmac%2Foverflow-scrollbars-toggle-dark-mode.html

IMAGE DIFF URL:
https://build.webkit.org/results/Apple-BigSur-Release-AppleSilicon-WK2-Tests/r277080%20(1316)/fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode-diffs.html

I have attached the images to this bug below.
Comment 1 Robert Jenner 2021-05-06 17:36:00 PDT
Created attachment 427965 [details]
Diff files for image failures

Attaching diff images to bug.
Comment 2 Robert Jenner 2021-05-06 17:42:23 PDT
I don't have access to an Apple Silicon Mac, so I can't reproduce in that environment. However, I was able to reproduce the failure on an Intel Mac running Catalina Debug ToT using the following test:

run-webkit-tests fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html --iterations 1000 -f 


I was also able to reproduce the failure over 5,600 revisions back. So this appears to have been a flaky failure for a while.
Comment 3 Robert Jenner 2021-05-06 17:57:42 PDT
Updated test expectations here to flaky ( Pass ImageOnlyFailure ) here:
https://trac.webkit.org/changeset/277146/webkit
Comment 4 Radar WebKit Bug Importer 2021-05-06 17:58:29 PDT
<rdar://problem/77634423>