Bug 244538 – Test addition (247271@main): [ macOS wk1 ] imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-margin-003.html is a flaky image failure

• Status: RESOLVED
• Resolution: WONTFIX
• Component: New Bugs

[Karl Rackler]

Description:
imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-margin-003.html

This test was added at 230283@main and was a consistent image failure until, at 247271@main, it began to flaky image fail.

REPRODUCTION STEPS
I can reproduce this on 253939@main ToT.

Command: 
run-webkit-tests --debug -1 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-margin-003.html

Result: 
Unexpected flakiness: image-only failures (1)
  imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-margin-003.html [ Pass ImageOnlyFailure ]

History:
https://results.webkit.org/?limit=50000&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scroll-snap%2Fscroll-target-margin-003.html&platform=mac&style=debug&flavor=wk1&recent=false

Image Diff:
https://build.webkit.org/results/Apple-Monterey-Debug-WK1-Tests/253917@main%20(3371)/imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-margin-003-diffs.html

[Radar WebKit Bug Importer]

<rdar://problem/99331640>

[Karl Rackler]

I have marked this test as a flaky image failure while this issue is investigated.

[EWS]

Test gardening commit 253944@main (383176abb289): <https://commits.webkit.org/253944@main>

Reviewed commits have been landed. Closing PR #3808 and removing active labels.

[Karl Rackler]

The test has began flaky image failure on release also.

[EWS]

Test gardening commit 291334@main (b4890b8806b2): <https://commits.webkit.org/291334@main>

Reviewed commits have been landed. Closing PR #41628 and removing active labels.

[Nikolas Zimmermann]

Also flaky on WPE: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scroll-snap%2Fscroll-target-margin-003.html&platform=GTK&platform=WPE

[Jonathan Bedard]

Closing WebKitLegacy testing bugs as we cut-back WebKitLegacy testing. See https://bugs.webkit.org/show_bug.cgi?id=304436.