Bug 272101 – [ Sonoma WK1 ] 7X imported/w3c/web-platform-tests/worklets tests are flaky failures

• Status: NEW
• Component: New Bugs

[Jay Stfleur]

Created attachment 470749 [details]
DIff for all tests

Description:
imported/w3c/web-platform-tests/worklets/animation-worklet-credentials.https.html
imported/w3c/web-platform-tests/worklets/audio-worklet-credentials.https.html
imported/w3c/web-platform-tests/worklets/audio-worklet-csp.https.html 
imported/w3c/web-platform-tests/worklets/audio-worklet-import.https.html 
imported/w3c/web-platform-tests/worklets/audio-worklet-referrer.https.html 
imported/w3c/web-platform-tests/worklets/layout-worklet-credentials.https.html
imported/w3c/web-platform-tests/worklets/paint-worklet-credentials.https.html

All 7 tests have been a flaky failure since 23A344 and still failing on 23E224 on Sonoma WK1.

Build URL:
https://build.webkit.org/#/builders/937/builds/2454

History:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fworklets%2Fanimation-worklet-credentials.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fworklets%2Faudio-worklet-credentials.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fworklets%2Faudio-worklet-csp.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fworklets%2Faudio-worklet-import.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fworklets%2Faudio-worklet-referrer.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fworklets%2Flayout-worklet-credentials.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fworklets%2Fpaint-worklet-credentials.https.html&version_name=Sonoma&flavor=wk1&recent=false&limit=50000

Diff/Image Diff/Crash Log:
--- /Volumes/Data/worker/Apple-Sonoma-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/worklets/audio-worklet-csp.https-expected.txt
+++ /Volumes/Data/worker/Apple-Sonoma-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/worklets/audio-worklet-csp.https-actual.txt
@@ -20,22 +20,22 @@
 PASS A remote-origin worklet should be blocked by the script-src 'self' directive.
 PASS A same-origin worklet importing a remote-origin script should be blocked by the script-src 'self' directive.
 PASS A remote-origin worklet importing a remote-origin script should be blocked by the script-src 'self' directive.
-FAIL A remote-origin-redirected worklet should be blocked by the script-src 'self' directive. assert_equals: expected "REJECTED" but got "RESOLVED"
+PASS A remote-origin-redirected worklet should be blocked by the script-src 'self' directive.
 PASS A same-origin worklet importing a remote-origin-redirected script should be blocked by the script-src 'self' directive.
-PASS A remote-origin worklet should not be blocked because the script-src directive specifying the origin allows it.
+FAIL A remote-origin worklet should not be blocked because the script-src directive specifying the origin allows it. assert_equals: expected "RESOLVED" but got "REJECTED"
 FAIL A same-origin worklet importing a remote-origin script should not be blocked because the script-src directive specifying the origin allows it. assert_equals: expected "RESOLVED" but got "REJECTED"
-PASS A remote-origin worklet importing a remote-origin script should not be blocked because the script-src directive specifying the origin allows it.
-PASS A remote-origin-redirected worklet should not be blocked because the script-src directive specifying the origin allows it.
+FAIL A remote-origin worklet importing a remote-origin script should not be blocked because the script-src directive specifying the origin allows it. assert_equals: expected "RESOLVED" but got "REJECTED"
+FAIL A remote-origin-redirected worklet should not be blocked because the script-src directive specifying the origin allows it. assert_equals: expected "RESOLVED" but got "REJECTED"
 FAIL A same-origin worklet importing a remote-origin-redirected script should not be blocked because the script-src directive specifying the origin allows it. assert_equals: expected "RESOLVED" but got "REJECTED"
-PASS A remote-origin worklet should not be blocked because the script-src * directive allows it.
+FAIL A remote-origin worklet should not be blocked because the script-src * directive allows it. assert_equals: expected "RESOLVED" but got "REJECTED"
 FAIL A same-origin worklet importing a remote-origin script should not be blocked because the script-src * directive allows it. assert_equals: expected "RESOLVED" but got "REJECTED"
-PASS A remote-origin worklet importing a remote-origin script should not be blocked because the script-src * directive allows it.
-PASS A remote-origin-redirected worklet should not be blocked because the script-src * directive allows it.
+FAIL A remote-origin worklet importing a remote-origin script should not be blocked because the script-src * directive allows it. assert_equals: expected "RESOLVED" but got "REJECTED"
+FAIL A remote-origin-redirected worklet should not be blocked because the script-src * directive allows it. assert_equals: expected "RESOLVED" but got "REJECTED"
 FAIL A same-origin worklet importing a remote-origin-redirected script should not be blocked because the script-src * directive allows it. assert_equals: expected "RESOLVED" but got "REJECTED"
-PASS A remote-origin worklet should not be blocked by the worker-src directive because worklets obey the script-src directive.
+FAIL A remote-origin worklet should not be blocked by the worker-src directive because worklets obey the script-src directive. assert_equals: expected "RESOLVED" but got "REJECTED"
 FAIL A same-origin worklet importing a remote-origin script should not be blocked by the worker-src directive because worklets obey the script-src directive. assert_equals: expected "RESOLVED" but got "REJECTED"
-PASS A remote-origin worklet importing a remote-origin script should not be blocked by the worker-src directive because worklets obey the script-src directive.
-PASS A remote-origin-redirected worklet should not be blocked by the worker-src directive because worklets obey the script-src directive.
+FAIL A remote-origin worklet importing a remote-origin script should not be blocked by the worker-src directive because worklets obey the script-src directive. assert_equals: expected "RESOLVED" but got "REJECTED"
+FAIL A remote-origin-redirected worklet should not be blocked by the worker-src directive because worklets obey the script-src directive. assert_equals: expected "RESOLVED" but got "REJECTED"
 FAIL A same-origin worklet importing a remote-origin-redirected script should not be blocked by the worker-src directive because worklets obey the script-src directive. assert_equals: expected "RESOLVED" but got "REJECTED"
 PASS An insecure-origin worklet should be blocked because of mixed contents.
 PASS An insecure-origin-redirected worklet should be blocked because of mixed contents.

[Radar WebKit Bug Importer]

<rdar://problem/125862089>

[Ryosuke Niwa]

I can't reproduce these failures locally.