Bug 287291 – New test (268919@main): [ iOS ] http/tests/site-isolation/selection-focus.html is a constant failure.

• Component: Tools / Tests
• Status: REOPENED

[Yasmin Karimi]

Created attachment 474161 [details]
pdf/images/jpeg2000-embed-pdf.webarchive

http/tests/site-isolation/selection-focus.html

This test is constantly failing on iOS. 

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fsite-isolation%2Fselection-focus.html

IMAGE DIFF:

Attached

DIFF URL:

https://build.webkit.org/results/Apple-iOS-18-Simulator-Release-WK2-Tests/289955@main%20(598)/http/tests/site-isolation/selection-focus-diffs.html

REPRODUCIBILITY:

I was able to reproduce this issue on the iOS 18.2 simulator at ToT using the following command:

run-webkit-tests --ios-simulator http/tests/site-isolation/selection-focus.html --child-process=1 --iterations 300

REGRESSION:

This test appears to be constantly failing since it was introduced at 268919@main.

[Radar WebKit Bug Importer]

<rdar://problem/144412355>

[EWS]

Test gardening commit 290051@main (65866824e54b): <https://commits.webkit.org/290051@main>

Reviewed commits have been landed. Closing PR #40248 and removing active labels.

Pull request: https://github.com/WebKit/WebKit/pull/50472

[EWS]

Committed 299738@main (379f807d0ee2): <https://commits.webkit.org/299738@main>

Reviewed commits have been landed. Closing PR #50472 and removing active labels.

[Jonathan Bedard]

http/tests/site-isolation/selection-focus.html is still failing, we should increase the fuzziness more.

[Jonathan Bedard]

This appears to be some sort of crash or crash-like behavior in ImageDiff:

10:53:22.811 55246 worker/4 Test marked as failed, ImageDiff crashed because of no data while reading stdout for the server process.
10:53:22.812 55246 worker/4   http/tests/site-isolation/iframe-dark-mode-print.html : ImageDiff produced stderr output:
Error: test and reference images have different sizes. Test image is 800x600, reference image is 1600x1200
ImageDiff crashed
10:53:22.814 55246 worker/4 http/tests/site-isolation/iframe-dark-mode-print.html failed:
10:53:22.814 55246 worker/4 reference mismatch