Bug 244358 - [ iOS macOS ] 4X imported/w3c/web-platform-tests/html/cross-origin-opener-policy/(Layout tests) are flaky timeouts
Summary: [ iOS macOS ] 4X imported/w3c/web-platform-tests/html/cross-origin-opener-pol...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Chris Dumez
URL:
Keywords: InRadar
: 244346 (view as bug list)
Depends on:
Blocks:
 
Reported: 2022-08-25 13:42 PDT by Hercules Hjalmarsson
Modified: 2023-01-17 15:10 PST (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Hercules Hjalmarsson 2022-08-25 13:42:11 PDT
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-unsafe-none.https.html
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-same-origin.https.html

Are four flaky text failures on iOS and macOS ToT and have started failing more consistently since a resync at 252960@main. 1 out of the 4 (imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html) was introduced at 252960@main. They all appear to have a similar DIFF errors "+Harness Error (TIMEOUT), message = null".

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Ftentative%2Frestrict-properties%2Fiframe-popup.https.html

DIFF 1:
--- /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https-expected.txt
+++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https-actual.txt
@@ -1,3 +1,6 @@
+
+
+Harness Error (TIMEOUT), message = null
 
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same origin iframe, same origin popup with window_open
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same origin iframe, same origin popup with anchor
@@ -24,6 +27,6 @@
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with anchor
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with form
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with window_open
-PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with anchor
-PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with form
+TIMEOUT COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with anchor Test timed out
+NOTRUN COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with form

DIFF 1 URL:
https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/253768@main%20(3491)/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https-pretty-diff.html

DIFF 2:
--- /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-same-origin.https-expected.txt
+++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-same-origin.https-actual.txt
@@ -1,3 +1,6 @@
+
+
+Harness Error (TIMEOUT), message = null
 
 PASS COOP: same-origin to popup COOP: same-origin via an iframe, with same origin iframe, same origin popup with window_open
 PASS COOP: same-origin to popup COOP: same-origin via an iframe, with same origin iframe, same origin popup with anchor
@@ -24,6 +27,6 @@
 PASS COOP: same-origin to popup COOP: same-origin via an iframe, with same site iframe, cross origin popup with anchor
 PASS COOP: same-origin to popup COOP: same-origin via an iframe, with same site iframe, cross origin popup with form
 PASS COOP: same-origin to popup COOP: same-origin via an iframe, with cross origin iframe, cross origin popup with window_open
-PASS COOP: same-origin to popup COOP: same-origin via an iframe, with cross origin iframe, cross origin popup with anchor
-PASS COOP: same-origin to popup COOP: same-origin via an iframe, with cross origin iframe, cross origin popup with form
+TIMEOUT COOP: same-origin to popup COOP: same-origin via an iframe, with cross origin iframe, cross origin popup with anchor Test timed out
+NOTRUN COOP: same-origin to popup COOP: same-origin via an iframe, with cross origin iframe, cross origin popup with form

DIFF 2 URL:
https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/253768@main%20(3491)/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-same-origin.https-pretty-diff.html

DIFF 3:
--- /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https-expected.txt
+++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 FAIL COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with same origin iframe, same origin popup with window_open assert_equals: Iframe has dom access to the popup? expected "false" but got "true"
 PASS COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with same origin iframe, same origin popup with anchor
@@ -24,6 +26,6 @@
 PASS COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with same site iframe, cross origin popup with anchor
 PASS COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with same site iframe, cross origin popup with form
 FAIL COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with cross origin iframe, cross origin popup with window_open assert_equals: Iframe has dom access to the popup? expected "false" but got "true"
-PASS COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with cross origin iframe, cross origin popup with anchor
-PASS COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with cross origin iframe, cross origin popup with form
+TIMEOUT COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with cross origin iframe, cross origin popup with anchor Test timed out
+NOTRUN COOP: restrict-properties to popup COOP: restrict-properties via an iframe, with cross origin iframe, cross origin popup with form

DIFF 3 URL:
https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/253768@main%20(3491)/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https-pretty-diff.html

DIFF 4:
--- /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-unsafe-none.https-expected.txt
+++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-unsafe-none.https-actual.txt
@@ -1,3 +1,6 @@
+
+
+Harness Error (TIMEOUT), message = null
 
 PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, same origin popup with window_open
 PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, same origin popup with anchor
@@ -18,12 +21,12 @@
 PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, same site popup with anchor
 PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, same site popup with form
 PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, cross origin popup with window_open
-PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, cross origin popup with anchor
-PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, cross origin popup with form
-PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with window_open
-PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with anchor
-PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with form
-PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with window_open
-PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with anchor
-PASS COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with form
+TIMEOUT COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, cross origin popup with anchor Test timed out
+NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with same origin iframe, cross origin popup with form
+NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with window_open
+NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with anchor
+NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with form
+NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with window_open
+NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with anchor
+NOTRUN COOP: same-origin to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with form

DIFF 4 URL:
https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/253768@main%20(3491)/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-unsafe-none.https-pretty-diff.html
Comment 1 Hercules Hjalmarsson 2022-08-25 13:44:45 PDT
*** Bug 244346 has been marked as a duplicate of this bug. ***
Comment 2 Radar WebKit Bug Importer 2022-08-25 13:45:56 PDT
<rdar://problem/99153669>
Comment 3 Hercules Hjalmarsson 2022-08-25 13:50:17 PDT
These issue can be bisected to 252960@main using command: 

run-webkit-tests -f --exit-after-n-failures 1 --force --child-processes=5 --ios-simulator --iterations=300   imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https.html
Comment 5 EWS 2022-08-25 14:48:58 PDT
Test gardening commit 253795@main (8b71bcc97367): <https://commits.webkit.org/253795@main>

Reviewed commits have been landed. Closing PR #3676 and removing active labels.
Comment 6 Chris Dumez 2023-01-13 19:03:52 PST
Pull request: https://github.com/WebKit/WebKit/pull/8651
Comment 7 EWS 2023-01-17 15:10:00 PST
Committed 259006@main (9833f67e85a7): <https://commits.webkit.org/259006@main>

Reviewed commits have been landed. Closing PR #8651 and removing active labels.