Bug 266996 - REGRESSION (272454@main): [ macOS iOS ] imported/w3c/web-platform-tests/css/css-writing-modes/mongolian-orientation-002.html is a consistent failure
Summary: REGRESSION (272454@main): [ macOS iOS ] imported/w3c/web-platform-tests/css/c...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Ahmad Saleem
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2024-01-02 12:22 PST by Marta Darbinyan
Modified: 2024-01-04 17:19 PST (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Marta Darbinyan 2024-01-02 12:22:43 PST
Description:
imported/w3c/web-platform-tests/css/css-writing-modes/mongolian-orientation-002.html

Is a constant failure on macOS and iOS ToT since the test expectation was removed in 272454@main.

This issue can be reproduced by using the command: 
run-webkit-tests --root  --exit-after-n-failures 1 --debug <test>


History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-writing-modes%2Fmongolian-orientation-002.html

Link:
https://build.webkit.org/results/Apple-Sonoma-Release-WK2-Tests/272567@main%20(1159)/imported/w3c/web-platform-tests/css/css-writing-modes/mongolian-orientation-002-diffs.html
Comment 1 Radar WebKit Bug Importer 2024-01-02 12:23:24 PST
<rdar://problem/120382293>
Comment 2 Ahmad Saleem 2024-01-02 12:35:51 PST
I will take it. I will add fuzziness.
Comment 3 Ahmad Saleem 2024-01-02 12:37:49 PST
@Elika - just to keep you in loop. It is leading to 0.07% pixel difference and as discussed (for different test) but for this, I will add fuzziness. Any other input before I do PR?

<meta name="fuzzy" content="maxDifference=254; totalPixels=0-804" />
Comment 4 Alexey Proskuryakov 2024-01-03 11:09:06 PST
I don't think that adding fuzziness is appropriate here. 

The difference is that the text is rendered in a different place, so if we add enough fuzziness to allow for that, then the test will be entirely ineffective.

I'm observing he same behavior in Chrome and in Firefox. So probably just a bad test?
Comment 5 EWS 2024-01-04 17:19:29 PST
Test gardening commit 272665@main (f4776fcf6c36): <https://commits.webkit.org/272665@main>

Reviewed commits have been landed. Closing PR #22411 and removing active labels.