Bug 243734 - REGRESSION(252960@main?): [ iOS ] 3X imported/w3c/web-platform-tests/html/cross-origin-opener-policy/(Layout Tests) are almost constant failures
Summary: REGRESSION(252960@main?): [ iOS ] 3X imported/w3c/web-platform-tests/html/cro...
Status: RESOLVED DUPLICATE of bug 243690
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-08-09 09:58 PDT by Hercules Hjalmarsson
Modified: 2022-08-09 16:41 PDT (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Hercules Hjalmarsson 2022-08-09 09:58:56 PDT
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https.html
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-same-origin.https.html

Are 3 almost constant text failures on iOS ToT. It appears that these tests share a similar (Harness Error (TIMEOUT), message = null) error which causes the 3 layout tests to fail frequently. They also appear to have the same regression point.

HISTORY:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Fiframe-popup-same-origin-allow-popups-to-unsafe-none.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Fiframe-popup-same-origin-to-same-origin.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Ftentative%2Frestrict-properties%2Fiframe-popup.https.html

DIFF:
--- /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https-expected.txt
+++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https-actual.txt
@@ -1,3 +1,6 @@
+
+
+Harness Error (TIMEOUT), message = null
 
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same origin iframe, same origin popup with window_open
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same origin iframe, same origin popup with anchor
@@ -24,6 +27,6 @@
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with anchor
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with form
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with window_open
-PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with anchor
-PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with form
+TIMEOUT COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with anchor Test timed out
+NOTRUN COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with form

URL:
https://build.webkit.org/results/Apple-iOS-15-Simulator-Release-WK2-Tests/253256@main%20(4052)/results.html
Comment 1 Radar WebKit Bug Importer 2022-08-09 09:59:19 PDT
<rdar://problem/98389860>
Comment 2 Hercules Hjalmarsson 2022-08-09 16:34:21 PDT
I'm unable to get these tests to fail/pass according to the history shown.

When running these tests with the --child-processes=X & -f parameter they always fail otherwise, they always pass. They also take a long time to run.

History would indicate that the regression should be around 252960@main.

Commands run:

run-webkit-tests --ios-simulator --child-processes=4 -f imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html

run-webkit-tests --ios-simulator imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html

run-webkit-tests --ios-simulator --debug --child-processes=4 -f imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html

run-webkit-tests --ios-simulator --debug imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html

I also downloaded builds similar to the bots and ran the same commands.
Comment 3 Hercules Hjalmarsson 2022-08-09 16:41:46 PDT

*** This bug has been marked as a duplicate of bug 243690 ***