243690 2022-08-08 14:17:25 -0700 REGRESSION (252960@main): [ iOS ] Four imported/w3c/web-platform-tests/html/cross-origin-opener-policy tests are a consistent/flaky failure 2022-11-07 15:57:31 -0800 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 rackler cdumez cdumez hhjalmarsson webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1889791 0 rackler 2022-08-08 14:17:25 -0700 Description: imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-same-origin-allow-popups.https.html imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-unsafe-none-to-same-origin.https.html imported/w3c/web-platform-tests/html/cross-origin-opener-policy/javascript-url.https.html imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup-to-so.https.html The most recent failure after a series of consistent passes for iOS that I see on the dashboard was on 7/29/2022 at 252966@main. The tests are constant failures on [ iOS Debug ] x86_64 and flaky failures on [ iOS Release ] x86_64. REPRODUCTION STEPS I can reproduce this on 252960@main but cannot reproduce it on 252959@main or earlier. Command: run-webkit-tests --ios-simulator --debug --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 --no-retry imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-same-origin-allow-popups.https.html Result: Regressions: Unexpected text-only failures (1) imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-same-origin-allow-popups.https.html [ Failure ] History: https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Fiframe-popup-same-origin-allow-popups-to-same-origin-allow-popups.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Fiframe-popup-unsafe-none-to-same-origin.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Fjavascript-url.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Ftentative%2Frestrict-properties%2Fiframe-popup-to-so.https.html&limit=50000&platform=ios&architecture=x86_64 Diff: --- /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-same-origin-allow-popups.https-expected.txt +++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-same-origin-allow-popups.https-actual.txt @@ -1,3 +1,6 @@ + + +Harness Error (TIMEOUT), message = null PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, same origin popup with window_open PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, same origin popup with anchor @@ -15,15 +18,15 @@ PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, same site popup with anchor PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, same site popup with form PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, same site popup with window_open -PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, same site popup with anchor -PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, same site popup with form -PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, cross origin popup with window_open -PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, cross origin popup with anchor -PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, cross origin popup with form -PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, cross origin popup with window_open -PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, cross origin popup with anchor -PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, cross origin popup with form -PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, cross origin popup with window_open -PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, cross origin popup with anchor -PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, cross origin popup with form +TIMEOUT COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, same site popup with anchor Test timed out +NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, same site popup with form +NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, cross origin popup with window_open +NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, cross origin popup with anchor +NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, cross origin popup with form +NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, cross origin popup with window_open +NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, cross origin popup with anchor +NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, cross origin popup with form +NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, cross origin popup with window_open +NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, cross origin popup with anchor +NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, cross origin popup with form 1889792 1 webkit-bug-importer 2022-08-08 14:17:47 -0700 <rdar://problem/98340758> 1889797 2 rackler 2022-08-08 14:30:21 -0700 The change happened after a WPT resync of html tests from upstream. The tests went from consistently passing to constant failures on [ iOS Debug ] x86_64 and flaky failures on [ iOS Release ] x86_64. 1889819 3 rackler 2022-08-08 15:49:57 -0700 I have marked these tests as a flaky failure while this issue is investigated. 1889820 4 ews-feeder 2022-08-08 15:54:37 -0700 Test gardening commit 253237@main (8aaa9c5b0c81): <https://commits.webkit.org/253237@main> Reviewed commits have been landed. Closing PR #3120 and removing active labels. 1890144 5 hhjalmarsson 2022-08-09 16:41:46 -0700 *** Bug 243734 has been marked as a duplicate of this bug. *** 1910459 6 cdumez 2022-11-04 16:42:51 -0700 Pull request: https://github.com/WebKit/WebKit/pull/6156 1910547 7 ews-feeder 2022-11-05 11:26:59 -0700 Committed 256358@main (689669ffb8f4): <https://commits.webkit.org/256358@main> Reviewed commits have been landed. Closing PR #6156 and removing active labels. 1910912 8 cdumez 2022-11-07 15:51:44 -0800 Reverted by https://github.com/WebKit/WebKit/pull/6228 1910913 9 cdumez 2022-11-07 15:51:48 -0800 Re-opening for pull request https://github.com/WebKit/WebKit/pull/6228 1910914 10 ews-feeder 2022-11-07 15:57:28 -0800 Committed 256429@main (f344e17405d4): <https://commits.webkit.org/256429@main> Reviewed commits have been landed. Closing PR #6228 and removing active labels.