207978 2020-02-19 17:23:03 -0800 [ Mac ] imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html is flaky failing. 2020-02-19 17:28:28 -0800 1 1 1 Unclassified WebKit Platform WebKit Nightly Build Mac macOS 10.15 NEW InRadar P2 Normal --- 1 Lawrence.j webkit-unassigned webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1620969 0 Lawrence.j 2020-02-19 17:23:03 -0800 imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html Description: This test is flaky failing on Mac throughout the visible history. The oldest diff that I am able to load is r254348, it matches exactly. History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fservice-workers%2Fservice-worker%2Fresource-timing.sub.https.html&limit=50000&platform=mac&style=release&style=debug Diff: --- /Volumes/Data/slave/catalina-debug-tests-wk2-gpuprocess/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https-expected.txt +++ /Volumes/Data/slave/catalina-debug-tests-wk2-gpuprocess/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https-actual.txt @@ -1,5 +1,5 @@ -FAIL Controlled resource loads assert_greater_than: Generated response expected a number greater than 0 but got 0 +FAIL Controlled resource loads assert_equals: Generated response expected 1 but got 2 PASS Non-controlled resource loads 1620970 1 webkit-bug-importer 2020-02-19 17:23:29 -0800 <rdar://problem/59613082> 1620971 2 Lawrence.j 2020-02-19 17:24:49 -0800 I am able to reproduce this issue locally with r256933 using the command below. run-webkit-tests imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html --iterations 4000 --exit-after-n-failures 5 -f --force -g [17/4000] imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html failed unexpectedly (text diff) [118/4000] imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html failed unexpectedly (text diff) [212/4000] imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html failed unexpectedly (text diff) [531/4000] imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html failed unexpectedly (text diff) [612/4000] imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html failed unexpectedly (text diff) Exiting early after 5 failures. 609 tests run. 604 tests ran as expected, 5 didn't (3391 didn't run): 1620974 3 Lawrence.j 2020-02-19 17:28:28 -0800 I have marked this test as failing while this issue is investigated. https://trac.webkit.org/changeset/257012/webkit