Bug 262088 – REGRESSION(266896@main): [ wk2 debug ] imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window.html is flaky failure

• Component: DOM
• Status: REOPENED

[Ben Schwartz]

imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window.html

This test is a near-constant/consistent failure on all platforms, wk2 debug builds.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Ffetch%2Fprivate-network-access%2Fiframe.tentative.https.window.html&style=debug

TEXT DIFF:

 
-PASS local to local: no preflight required.
-PASS local to private: no preflight required.
-PASS local to public: no preflight required.
-FAIL private to local: failed preflight. assert_equals: expected "timeout" but got "loaded"
+FAIL local to local: no preflight required. assert_equals: expected "loaded" but got "timeout"
+FAIL local to private: no preflight required. assert_equals: expected "loaded" but got "timeout"
+FAIL local to public: no preflight required. assert_equals: expected "loaded" but got "timeout"
+PASS private to local: failed preflight.
 PASS private to local: missing CORS headers.
 PASS private to local: missing PNA header.
 FAIL private to local: success. assert_equals: expected "loaded" but got "timeout"
-PASS private to private: no preflight required.
-PASS private to public: no preflight required.
-FAIL public to local: failed preflight. assert_equals: expected "timeout" but got "loaded"
+FAIL private to private: no preflight required. assert_equals: expected "loaded" but got "timeout"
+FAIL private to public: no preflight required. assert_equals: expected "loaded" but got "timeout"
+PASS public to local: failed preflight.
 PASS public to local: missing CORS headers.
 PASS public to local: missing PNA header.
 FAIL public to local: success. assert_equals: expected "loaded" but got "timeout"
-FAIL public to private: failed preflight. assert_equals: expected "timeout" but got "loaded"
+PASS public to private: failed preflight.
 PASS public to private: missing CORS headers.
 PASS public to private: missing PNA header.
 FAIL public to private: success. assert_equals: expected "loaded" but got "timeout"
-PASS public to public: no preflight required.
-FAIL treat-as-public-address to local: failed preflight. assert_equals: expected "timeout" but got "loaded"
+FAIL public to public: no preflight required. assert_equals: expected "loaded" but got "timeout"
+PASS treat-as-public-address to local: failed preflight.
 PASS treat-as-public-address to local: missing CORS headers.
 PASS treat-as-public-address to local: missing PNA header.
 FAIL treat-as-public-address to local: success. assert_equals: expected "loaded" but got "timeout"
-FAIL treat-as-public-address to private: failed preflight. assert_equals: expected "timeout" but got "loaded"
+PASS treat-as-public-address to private: failed preflight.
 PASS treat-as-public-address to private: missing CORS headers.
 PASS treat-as-public-address to private: missing PNA header.
 FAIL treat-as-public-address to private: success. assert_equals: expected "loaded" but got "timeout"

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Debug-AppleSilicon-WK2-Tests/268414@main%20(3733)/imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this issue on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-webkit-tests --debug --verbose --clobber-old-results imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window.html

[Radar WebKit Bug Importer]

<rdar://problem/116025642>

[EWS]

Test gardening commit 268424@main (4b69127af56d): <https://commits.webkit.org/268424@main>

Reviewed commits have been landed. Closing PR #18201 and removing active labels.

[Ryosuke Niwa]

I can't reproduce this failure on macOS Sonoma.

[Ben Schwartz]

Reproduced on macOS Sonoma using the following command:

run-webkit-tests --debug --verbose --clobber-old-results --force --iterations 100 --child-processes 10 -f --exit-after-n-failures 1 imported/w3c/web-platform-tests/fetch/private-network-access/iframe.tentative.https.window.html

[Ryosuke Niwa]

Pull request: https://github.com/WebKit/WebKit/pull/18284

[EWS]

Committed 268519@main (1cfc40dde59d): <https://commits.webkit.org/268519@main>

Reviewed commits have been landed. Closing PR #18284 and removing active labels.

[Ryosuke Niwa]

Hm... this test is still flaky.

[Ryosuke Niwa]

Pull request: https://github.com/WebKit/WebKit/pull/18357

[EWS]

Test gardening commit 268590@main (1242f2ee324a): <https://commits.webkit.org/268590@main>

Reviewed commits have been landed. Closing PR #18357 and removing active labels.