Bug 261052

Summary: REGRESSION(267516@main): [ macOS ] editing/mac/dictionary-lookup/dictionary-lookup.html is a constant text failure.
Product: WebKit Reporter: Ben Schwartz <ben_schwartz>
Component: TextAssignee: Nobody <webkit-unassigned>
Status: RESOLVED FIXED    
Severity: Normal CC: mmaxfield, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=261041
https://bugs.webkit.org/show_bug.cgi?id=259373
https://bugs.webkit.org/show_bug.cgi?id=261048
https://bugs.webkit.org/show_bug.cgi?id=261054

Description Ben Schwartz 2023-09-01 16:30:30 PDT
accessibility/mac/iframe-pdf.html

This test is a constant failure on all versions of macOS, wk2.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=editing%2Fmac%2Fdictionary-lookup%2Fdictionary-lookup.html

TEXT DIFF:

 Some text to look up.
 
 Lookup string for normal text: 'look'.
-Lookup string for title-case phrase: 'New'.
+Lookup string for title-case phrase: 'New York'.
 Lookup string for unselectable text: 'null'.

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/267553%40main%20(4741)/editing/mac/dictionary-lookup/dictionary-lookup-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-webkit-tests --clobber-old-results --verbose editing/mac/dictionary-lookup/dictionary-lookup.html

REGRESSION:

I was able to identify a clear regression point at 267516@main, as the issue did not reproduce at 267515@main and the test was constantly passing before this point.

NOTE:

It appears this test itself needs to be re-baselined, as there is a trivial difference in the test expectation ("New" instead of "New York") that is likely outdated.
Comment 1 Radar WebKit Bug Importer 2023-09-01 16:30:52 PDT
<rdar://problem/114846802>
Comment 2 Ben Schwartz 2023-09-01 16:32:52 PDT
CORRECTION:

editing/mac/dictionary-lookup/dictionary-lookup.html

This test is a constant failure on all versions of macOS.
Comment 3 EWS 2023-09-01 16:48:02 PDT
Test gardening commit 267567@main (37da045c5ae4): <https://commits.webkit.org/267567@main>

Reviewed commits have been landed. Closing PR #17362 and removing active labels.
Comment 4 Ben Schwartz 2023-09-01 17:10:33 PDT
Closing, as issue verified resolved after changes landed.