Bug 232184 - Regression (r284610?): [ iOS BigSur wk2 ]imported/w3c/web-platform-tests/html/cross-origin-opener-policy/coop-csp-sandbox.https.html is a flaky failure
Summary: Regression (r284610?): [ iOS BigSur wk2 ]imported/w3c/web-platform-tests/html...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-10-22 16:03 PDT by ayumi_kojima
Modified: 2021-10-22 16:20 PDT (History)
4 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description ayumi_kojima 2021-10-22 16:03:21 PDT 
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/coop-csp-sandbox.https.html

Is flaky failing on iOS 15 and Big Sur wk2 Debug.

History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Fcoop-csp-sandbox.https.html

Result page: https://build.webkit.org/results/Apple-iOS-15-Simulator-Release-WK2-Tests/r284693%20(274)/results.html

Diff:

--- /Volumes/Data/worker/ios-simulator-15-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/coop-csp-sandbox.https-expected.txt
+++ /Volumes/Data/worker/ios-simulator-15-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/coop-csp-sandbox.https-actual.txt
@@ -1,5 +1,3 @@
-CONSOLE MESSAGE: Navigation was blocked by Cross-Origin-Opener-Policy
-CONSOLE MESSAGE: Navigation was blocked by Cross-Origin-Opener-Policy
 
 PASS CSP: sandbox allow-popups allow-scripts allow-same-origin; CSP sandboxed Cross-Origin-Opener-Policy popup should result in a network error
 PASS CSP: sandbox allow-popups allow-scripts; CSP sandboxed Cross-Origin-Opener-Policy popup should result in a network error
Comment 1 Radar WebKit Bug Importer 2021-10-22 16:03:53 PDT 
<rdar://problem/84567378>
Comment 2 ayumi_kojima 2021-10-22 16:13:37 PDT 
I was not able to reproduce the failure locally on iOS 15 sim using run-webkit-tests --ios-simulator --iterations 50 --exit-after-n-failures 1 imported/w3c/web-platform-tests/html/cross-origin-opener-policy/coop-csp-sandbox.https.html7

According to the history, it looks like the test started being flaky somewhere between  r284607 and r284625.

The changes in https://trac.webkit.org/changeset/284610/webkit seems to be related.
Comment 3 Chris Dumez 2021-10-22 16:20:40 PDT 
Committed r284724 (243436@main): <https://commits.webkit.org/243436@main>