Bug 244358

Summary: [ iOS macOS ] 4X imported/w3c/web-platform-tests/html/cross-origin-opener-policy/(Layout tests) are flaky timeouts
Product: WebKit Reporter: Hercules Hjalmarsson <hhjalmarsson>
Component: New BugsAssignee: Chris Dumez <cdumez>
Status: RESOLVED FIXED    
Severity: Normal CC: cdumez, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Hercules Hjalmarsson
Reported 2022-08-25 13:42:11 PDT
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-unsafe-none.https.html imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-same-origin.https.html Are four flaky text failures on iOS and macOS ToT and have started failing more consistently since a resync at 252960@main. 1 out of the 4 (imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html) was introduced at 252960@main. They all appear to have a similar DIFF errors "+Harness Error (TIMEOUT), message = null". HISTORY: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Ftentative%2Frestrict-properties%2Fiframe-popup.https.html DIFF 1: --- /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https-expected.txt +++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https-actual.txt @@ -1,3 +1,6 @@ + + +Harness Error (TIMEOUT), message = null PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same origin iframe, same origin popup with window_open PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same origin iframe, same origin popup with anchor @@ -24,6 +27,6 @@ PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with anchor PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with form PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with window_open -PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with anchor -PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with form +TIMEOUT COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with anchor Test timed out +NOTRUN COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with form DIFF 1 URL: https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/253768@main%20(3491)/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https-pretty-diff.html DIFF 2: --- /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-same-origin.https-expected.txt +++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-same-origin.https-actual.txt @@ -1,3 +1,6 @@ + + +Harness Error (TIMEOUT), message = null PASS COOP: same-origin to popup COOP: same-origin via an iframe, with same origin iframe, same origin popup with window_open PASS COOP: same-origin to popup COOP: same-origin via an iframe, with same origin iframe, same origin popup with anchor @@ -24,6 +27,6 @@ PASS COOP: same-origin to popup COOP: same-origin via an iframe, with same site iframe, cross origin popup with anchor PASS COOP: same-origin to popup COOP: same-origin via an iframe, with same site iframe, cross origin popup with form PASS COOP: same-origin to popup COOP: same-origin via an iframe, with cross origin iframe, cross origin popup with window_open -PASS COOP: same-origin to popup COOP: same-origin via an iframe, with cross origin iframe, cross origin popup with anchor -PASS COOP: same-origin to popup COOP: same-origin via an iframe, with cross origin iframe, cross origin popup with form +TIMEOUT COOP: same-origin to popup COOP: same-origin via an iframe, with cross origin iframe, cross origin popup with anchor Test timed out +NOTRUN COOP: same-origin to popup COOP: same-origin via an iframe, with cross origin iframe, cross origin popup with form DIFF 2 URL: https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/253768@main%20(3491)/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-same-origin.https-pretty-diff.html DIFF 3: --- /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https-expected.txt +++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https-actual.txt @@ -1,3 +1,5 @@ + +Harness Error (TIMEOUT), message = null FAIL COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with same origin iframe, same origin popup with window_open assert_equals: Iframe has dom access to the popup? expected "false" but got "true" PASS COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with same origin iframe, same origin popup with anchor @@ -24,6 +26,6 @@ PASS COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with same site iframe, cross origin popup with anchor PASS COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with same site iframe, cross origin popup with form FAIL COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with cross origin iframe, cross origin popup with window_open assert_equals: Iframe has dom access to the popup? expected "false" but got "true" -PASS COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with cross origin iframe, cross origin popup with anchor -PASS COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with cross origin iframe, cross origin popup with form +TIMEOUT COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with cross origin iframe, cross origin popup with anchor Test timed out +NOTRUN COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with cross origin iframe, cross origin popup with form DIFF 3 URL: https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/253768@main%20(3491)/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https-pretty-diff.html DIFF 4: --- /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-unsafe-none.https-expected.txt +++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-unsafe-none.https-actual.txt @@ -1,3 +1,6 @@ + + +Harness Error (TIMEOUT), message = null PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, same origin popup with window_open PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, same origin popup with anchor @@ -18,12 +21,12 @@ PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, same site popup with anchor PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, same site popup with form PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, cross origin popup with window_open -PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, cross origin popup with anchor -PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, cross origin popup with form -PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with window_open -PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with anchor -PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with form -PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with window_open -PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with anchor -PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with form +TIMEOUT COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, cross origin popup with anchor Test timed out +NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, cross origin popup with form +NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with window_open +NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with anchor +NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with form +NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with window_open +NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with anchor +NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with form DIFF 4 URL: https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/253768@main%20(3491)/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-unsafe-none.https-pretty-diff.html
Attachments
Add attachment proposed patch, testcase, etc.
Hercules Hjalmarsson
Comment 1 2022-08-25 13:44:45 PDT
*** Bug 244346 has been marked as a duplicate of this bug. ***
Radar WebKit Bug Importer
Comment 2 2022-08-25 13:45:56 PDT
<rdar://problem/99153669>
Hercules Hjalmarsson
Comment 3 2022-08-25 13:50:17 PDT
These issue can be bisected to 252960@main using command: run-webkit-tests -f --exit-after-n-failures 1 --force --child-processes=5 --ios-simulator --iterations=300 imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https.html
EWS
Comment 5 2022-08-25 14:48:58 PDT
Test gardening commit 253795@main (8b71bcc97367): <https://commits.webkit.org/253795@main> Reviewed commits have been landed. Closing PR #3676 and removing active labels.
Chris Dumez
Comment 6 2023-01-13 19:03:52 PST
Pull request: https://github.com/WebKit/WebKit/pull/8651
EWS
Comment 7 2023-01-17 15:10:00 PST
Committed 259006@main (9833f67e85a7): <https://commits.webkit.org/259006@main> Reviewed commits have been landed. Closing PR #8651 and removing active labels.
Note You need to log in before you can comment on or make changes to this bug.