Bug 240037 - [ iOS ] css3/background/background-repeat-space-content.html is a flaky image failure
Summary: [ iOS ] css3/background/background-repeat-space-content.html is a flaky image...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Karl Rackler
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-05-03 14:06 PDT by Karl Rackler
Modified: 2022-05-03 16:44 PDT (History)
4 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Karl Rackler 2022-05-03 14:06:38 PDT 
Description:
css3/background/background-repeat-space-content.html

The first failure that I saw on the dashboard was 12/14/2021 at r287060, but this does not appear relevant to causing this issue.  This test seems to have been flaky since the start.

History:
https://results.webkit.org/?suite=layout-tests&test=css3%2Fbackground%2Fbackground-repeat-space-content.html&platform=ios&limit=50000

Image Diff:
https://build.webkit.org/results/Apple-iOS-15-Simulator-Release-WK2-Tests/250205@main%20(2446)/css3/background/background-repeat-space-content-diffs.html
Comment 1 Radar WebKit Bug Importer 2022-05-03 14:06:56 PDT 
<rdar://problem/92692179>
Comment 2 Karl Rackler 2022-05-03 14:08:36 PDT 
I have marked this test as a flaky image failure while this issue is investigated.
Comment 3 Karl Rackler 2022-05-03 14:15:00 PDT 
Pull request: https://github.com/WebKit/WebKit/pull/480
Comment 4 EWS 2022-05-03 14:19:26 PDT 
Test gardening commit r293739 (250227@main): <https://commits.webkit.org/250227@main>

Reviewed commits have been landed. Closing PR #480 and removing active labels.
Comment 5 Simon Fraser (smfr) 2022-05-03 14:53:42 PDT 
r293447 didn't fix this?
Comment 6 Simon Fraser (smfr) 2022-05-03 15:04:29 PDT 
For cases like this where the pixel differences are consistent, we should be using pixel tolerance to make them pass.

Example: r288449
Comment 7 Karl Rackler 2022-05-03 16:40:53 PDT 
REPRODUCTION STEPS
I can reproduce this on ToT (r293740).

Command: 
run-webkit-tests --root 293740 --ios-simulator --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --details --debug-rwt-logging --pixel-tests --tolerance 0.10 --iterations 2000 --no-retry css3/background/background-repeat-space-content.html

Result:  
Unexpected flakiness: image-only failures (1)
  css3/background/background-repeat-space-content.html [ ImageOnlyFailure Pass ]
Comment 8 Alexey Proskuryakov 2022-05-03 16:44:53 PDT 
How can this be flaky? We are just drawing the same circle.png in both actual and expected.