232184 2021-10-22 16:03:21 -0700 Regression (r284610?): [ iOS BigSur wk2 ]imported/w3c/web-platform-tests/html/cross-origin-opener-policy/coop-csp-sandbox.https.html is a flaky failure 2021-10-22 16:20:40 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 ayumi_kojima webkit-unassigned bfulgham cdumez webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1807923 0 ayumi_kojima 2021-10-22 16:03:21 -0700 imported/w3c/web-platform-tests/html/cross-origin-opener-policy/coop-csp-sandbox.https.html Is flaky failing on iOS 15 and Big Sur wk2 Debug. History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Fcoop-csp-sandbox.https.html Result page: https://build.webkit.org/results/Apple-iOS-15-Simulator-Release-WK2-Tests/r284693%20(274)/results.html Diff: --- /Volumes/Data/worker/ios-simulator-15-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/coop-csp-sandbox.https-expected.txt +++ /Volumes/Data/worker/ios-simulator-15-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/coop-csp-sandbox.https-actual.txt @@ -1,5 +1,3 @@ -CONSOLE MESSAGE: Navigation was blocked by Cross-Origin-Opener-Policy -CONSOLE MESSAGE: Navigation was blocked by Cross-Origin-Opener-Policy PASS CSP: sandbox allow-popups allow-scripts allow-same-origin; CSP sandboxed Cross-Origin-Opener-Policy popup should result in a network error PASS CSP: sandbox allow-popups allow-scripts; CSP sandboxed Cross-Origin-Opener-Policy popup should result in a network error 1807924 1 webkit-bug-importer 2021-10-22 16:03:53 -0700 <rdar://problem/84567378> 1807932 2 ayumi_kojima 2021-10-22 16:13:37 -0700 I was not able to reproduce the failure locally on iOS 15 sim using run-webkit-tests --ios-simulator --iterations 50 --exit-after-n-failures 1 imported/w3c/web-platform-tests/html/cross-origin-opener-policy/coop-csp-sandbox.https.html7 According to the history, it looks like the test started being flaky somewhere between r284607 and r284625. The changes in https://trac.webkit.org/changeset/284610/webkit seems to be related. 1807938 3 cdumez 2021-10-22 16:20:40 -0700 Committed r284724 (243436@main): <https://commits.webkit.org/243436@main>