228327 2021-07-27 09:03:47 -0700 [iOS Release] 2 imported/w3c/web-platform-tests/worklets tests are flaky failing 2021-07-27 10:26:15 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build iPhone / iPad Unspecified NEW InRadar P2 Normal --- 1 ayumi_kojima webkit-unassigned cdumez webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1779750 0 ayumi_kojima 2021-07-27 09:03:47 -0700 imported/w3c/web-platform-tests/worklets/audio-worklet-service-worker-interception.https.html Is flaky failing on iOS 14 E Simulator wk2 Release. History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fworklets%2Faudio-worklet-service-worker-interception.https.html&platform=ios Diff: --- /Volumes/Data/worker/ipados-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/worklets/audio-worklet-service-worker-interception.https-expected.txt +++ /Volumes/Data/worker/ipados-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/worklets/audio-worklet-service-worker-interception.https-actual.txt @@ -1,5 +1,7 @@ -PASS addModule() on a controlled document should be intercepted by a service worker. -PASS addModule() on a non-controlled document should not be intercepted by a service worker even if the script is under the service worker scope. -PASS Static import should be intercepted by a service worker. +Harness Error (TIMEOUT), message = null +TIMEOUT addModule() on a controlled document should be intercepted by a service worker. Test timed out +NOTRUN addModule() on a non-controlled document should not be intercepted by a service worker even if the script is under the service worker scope. +NOTRUN Static import should be intercepted by a service worker. + 1779759 1 ayumi_kojima 2021-07-27 09:32:53 -0700 I was not able to reproduce the failure on iOS 15 simulator on my local machine using: run-webkit-tests --ios-simulator --release --iterations 500 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 imported/w3c/web-platform-tests/worklets/audio-worklet-service-worker-interception.https.html The test timed out instead of failing. It seems it's been flaky as long as I can see in the history (the oldest revision is r277101). The test is imported at r270016. Updated test expectations https://trac.webkit.org/changeset/280340/webkit 1779762 2 webkit-bug-importer 2021-07-27 09:35:54 -0700 <rdar://problem/81167040> 1779763 3 ayumi_kojima 2021-07-27 09:45:56 -0700 imported/w3c/web-platform-tests/worklets/paint-worklet-service-worker-interception.https.html Is also flaky failing iOS 14 E Simulator wk2 Release. History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fworklets%2Fpaint-worklet-service-worker-interception.https.html&platform=ios Diff: --- /Volumes/Data/worker/ipados-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/worklets/paint-worklet-service-worker-interception.https-expected.txt +++ /Volumes/Data/worker/ipados-simulator-14-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/worklets/paint-worklet-service-worker-interception.https-actual.txt @@ -1,8 +1,7 @@ -CONSOLE MESSAGE: Error: Script error. -CONSOLE MESSAGE: Error: Script error. -CONSOLE MESSAGE: Error: Script error. -PASS addModule() on a controlled document should be intercepted by a service worker. -FAIL addModule() on a non-controlled document should not be intercepted by a service worker even if the script is under the service worker scope. assert_equals: expected "REJECTED" but got "RESOLVED" -PASS Static import should be intercepted by a service worker. +Harness Error (TIMEOUT), message = null +TIMEOUT addModule() on a controlled document should be intercepted by a service worker. Test timed out +NOTRUN addModule() on a non-controlled document should not be intercepted by a service worker even if the script is under the service worker scope. +NOTRUN Static import should be intercepted by a service worker. + 1779779 4 ayumi_kojima 2021-07-27 10:26:15 -0700 Updated test expectations https://trac.webkit.org/changeset/280343/webkit