Bug 231083 – [ iOS Mac wk2 Debug ] imported/w3c/web-platform-tests/content-security-policy/generic/policy-inherited-correctly-by-plznavigate.html is a flaky failure

• Status: NEW
• Component: New Bugs

[Eric Hutchison]

imported/w3c/web-platform-tests/content-security-policy/generic/policy-inherited-correctly-by-plznavigate.html

is a flaky failure on iOS15 and Mac wk2 Debug. 

Build: https://ews-build.webkit.org/#/builders/60/builds/13215

History: https://results.webkit.org/?suite=layout-tests&test=imported/w3c/web-platform-tests/content-security-policy/generic/policy-inherited-correctly-by-plznavigate.html

Results: https://ews-build.s3-us-west-2.amazonaws.com/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/r439817-13215/results.html

Diff:
--- /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/content-security-policy/generic/policy-inherited-correctly-by-plznavigate-expected.txt
+++ /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/content-security-policy/generic/policy-inherited-correctly-by-plznavigate-actual.txt
@@ -1,4 +1,5 @@
 
 
 PASS iframe still inherits correct CSP
+FAIL Violation report status OK. undefined is not an object (evaluating 'data[0]["body"]')
 
Reproduced test result locally on ToT (r283365) using run-webkit-tests -debug --iterations 1000 --exit-after-n-crashes-or-timeouts 1 -f --force --clobber-old-results imported/w3c/web-platform-tests/content-security-policy/generic/policy-inherited-correctly-by-plznavigate.html

[Radar WebKit Bug Importer]

<rdar://problem/83768675>

[Eric Hutchison]

Updated test expectations at https://trac.webkit.org/changeset/283372/webkit

The failure is showing up on iOS 14 EWS as a flaky failure https://ews-build.webkit.org/#/builders/51/builds/23425

Updated expectation to speed up EWS https://trac.webkit.org/changeset/284172/webkit

[Karl Rackler]

Recent Test Run:
https://build.webkit.org/#/builders/934/builds/5675
layout-tests Full log
06:01:03.856 73206 worker/2 imported/w3c/web-platform-tests/content-security-policy/generic/policy-inherited-correctly-by-plznavigate.html failed:
06:01:03.856 73206 worker/2 text diff

The test is still a flaky failure on MacOS Debug wk2, but is also now also on Release.

[Karl Rackler]

<rdar://146489569>

[EWS]

Test gardening commit 291779@main (93b2d6aa372f): <https://commits.webkit.org/291779@main>

Reviewed commits have been landed. Closing PR #42089 and removing active labels.