Bug 225498

Summary: [ macOS wk2 ] fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html (layout-test) is a flaky Image failure
Product: WebKit Reporter: Robert Jenner <jenner>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: simon.fraser, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Diff files for image failures none

Description Robert Jenner 2021-05-06 17:34:35 PDT
fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html

is a flaky image failure on macOS wk 2. The failure mostly occurs on BigSur running on Apple Silicon Macs. However, it has also failed twice on Intel Macs running Catalina. 

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=fast%2Fscrolling%2Fmac%2Foverflow-scrollbars-toggle-dark-mode.html

IMAGE DIFF URL:
https://build.webkit.org/results/Apple-BigSur-Release-AppleSilicon-WK2-Tests/r277080%20(1316)/fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode-diffs.html

I have attached the images to this bug below.
Comment 1 Robert Jenner 2021-05-06 17:36:00 PDT
Created attachment 427965 [details]
Diff files for image failures

Attaching diff images to bug.
Comment 2 Robert Jenner 2021-05-06 17:42:23 PDT
I don't have access to an Apple Silicon Mac, so I can't reproduce in that environment. However, I was able to reproduce the failure on an Intel Mac running Catalina Debug ToT using the following test:

run-webkit-tests fast/scrolling/mac/overflow-scrollbars-toggle-dark-mode.html --iterations 1000 -f 


I was also able to reproduce the failure over 5,600 revisions back. So this appears to have been a flaky failure for a while.
Comment 3 Robert Jenner 2021-05-06 17:57:42 PDT
Updated test expectations here to flaky ( Pass ImageOnlyFailure ) here:
https://trac.webkit.org/changeset/277146/webkit
Comment 4 Radar WebKit Bug Importer 2021-05-06 17:58:29 PDT
<rdar://problem/77634423>