Bug 239871 – [ macOS wk1 ] Four imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-upperlower tests are flaky image failures

• Status: NEW
• Component: New Bugs

[Karl Rackler]

Description:
imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-upperlower-003.html

The first failure that I saw on the dashboard for Big Sur was 2/15/2022 at r289847, and covers EWS rebase and is not relevant to causing this issue.  The first failure that I saw on the dashboard for Monterey was 3/17/2022 at r291422 but is modifying WebGPU/buffer and does not appear to be causing this issue.   This test seems to have been flaky since the start. 

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-text%2Ftext-transform%2Ftext-transform-upperlower-003.html&platform=mac&flavor=wk1&limit=50000

Image Diff:
https://build.webkit.org/results/Apple-Monterey-Debug-WK1-Tests/250087@main%20(1970)/imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-upperlower-003-diffs.html

[Radar WebKit Bug Importer]

<rdar://problem/92485701>

[Karl Rackler]

REPRODUCTION STEPS
I can reproduce this on ToT (r293579).

Command: 
run-webkit-tests --root -1 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --pixel-tests --tolerance 0.0364 --iterations 100 -f --no-retry

Result:
Unexpected flakiness: image-only failures (1)
  imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-upperlower-003.html [ Pass ImageOnlyFailure ]

[Karl Rackler]

I have marked this test as a flaky image failure while this issue is investigated.

[Karl Rackler]

Pull request: https://github.com/WebKit/WebKit/pull/429

[EWS]

Test gardening commit r293594 (250103@main): <https://commits.webkit.org/250103@main>

Reviewed commits have been landed. Closing PR #429 and removing active labels.

[Karl Rackler]

Description:
imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-upperlower-003.html
ADDING: 
imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-upperlower-007.html
imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-upperlower-015.html
imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-upperlower-102.html

After a series of consistent passes, the test imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-upperlower-003.html begins to fail at approximately 249091@main.

The other three tests after a series of consistent passes, begin to fail at approximately245577@main.  

History:
https://results.webkit.org/?limit=50000&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-text%2Ftext-transform%2Ftext-transform-upperlower-007.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-text%2Ftext-transform%2Ftext-transform-upperlower-015.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-text%2Ftext-transform%2Ftext-transform-upperlower-102.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-text%2Ftext-transform%2Ftext-transform-upperlower-003.html&platform=mac&flavor=wk1&recent=false

I have marked these tests as flaky image failures while this issue is investigated.

[EWS]

Test gardening commit 253798@main (a3ccc9ae0d48): <https://commits.webkit.org/253798@main>

Reviewed commits have been landed. Closing PR #3681 and removing active labels.