228245 2021-07-23 13:52:42 -0700 [BigSur wk1 Release arm64] imported/w3c/web-platform-tests/workers/modules/shared-worker-import-csp.html is a flaky failure 2021-09-15 12:13:12 -0700 1 1 1 Unclassified WebKit Service Workers WebKit Nightly Build Unspecified Unspecified NEW InRadar P2 Normal --- 1 ehutchison webkit-unassigned bfulgham cdumez ehutchison webkit-bot-watchers-bugzilla webkit-bug-importer youennf oldest_to_newest 1779161 0 ehutchison 2021-07-23 13:52:42 -0700 imported/w3c/web-platform-tests/workers/modules/shared-worker-import-csp.html is a flaky failure on BigSur wk1 Release arm64 since test release on platform. History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fworkers%2Fmodules%2Fshared-worker-import-csp.html&platform=ios&platform=mac Diff: --- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/workers/modules/shared-worker-import-csp-expected.txt +++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/workers/modules/shared-worker-import-csp-actual.txt @@ -14,15 +14,4 @@ CONSOLE MESSAGE: ReferenceError: Can't find variable: SharedWorker CONSOLE MESSAGE: ReferenceError: Can't find variable: SharedWorker CONSOLE MESSAGE: ReferenceError: Can't find variable: SharedWorker -CONSOLE MESSAGE: ReferenceError: Can't find variable: SharedWorker -FAIL worker-src 'self' directive should disallow cross origin static import. assert_array_equals: value is object "[object Object]", expected array -FAIL worker-src * directive should allow cross origin static import. assert_array_equals: value is object "[object Object]", expected array -FAIL script-src 'self' directive should disallow cross origin static import. assert_array_equals: value is object "[object Object]", expected array -FAIL script-src * directive should allow cross origin static import. assert_array_equals: value is object "[object Object]", expected array -FAIL worker-src * directive should override script-src 'self' directive and allow cross origin static import. assert_array_equals: value is object "[object Object]", expected array -FAIL worker-src 'self' directive should override script-src * directive and disallow cross origin static import. assert_array_equals: value is object "[object Object]", expected array -FAIL script-src 'self' directive should disallow cross origin dynamic import. assert_array_equals: value is object "[object Object]", expected array -FAIL script-src * directive should allow cross origin dynamic import. assert_array_equals: value is object "[object Object]", expected array -FAIL worker-src 'self' directive should not take effect on dynamic import. assert_array_equals: value is object "[object Object]", expected array - Reproduced using run-webkit-tests -1 --iterations 500 --exit-after-n-failures 2 -f imported/w3c/web-platform-tests/workers/modules/shared-worker-import-csp.html on r280247 1779162 1 webkit-bug-importer 2021-07-23 13:53:37 -0700 <rdar://problem/81034895> 1779164 2 ehutchison 2021-07-23 14:01:18 -0700 Updated test expectations on https://trac.webkit.org/changeset/280257/webkit. 1793797 3 cdumez 2021-09-15 12:13:12 -0700 Seems to have to do with the following code in LayoutTests/resources/testharnessreport.js: ``` // Wait for any other completion callbacks, which may eliminate test elements // from the page and therefore reduce the output. setTimeout(function () { testRunner.forceImmediateCompletion(); }, 0); ``` The 0 timer here seems to sometimes cause the test to finish before all the windows have closed (Test relies on `add_result_callback(() => win.close());`) and it affects the output.