Bug 223472 – [ BigSur Release Arm64 ] imported/w3c/web-platform-tests/resource-timing/resource_timing.worker.html is a flakey text failure

• Component: New Bugs
• Status: REOPENED

[Robert Jenner]

imported/w3c/web-platform-tests/resource-timing/resource_timing.worker.html

is a flakey text failure in macOS BigSur release wk2 on Apple Silicon only. 


https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fresource-timing%2Fresource_timing.worker.html


TEXT DIFF:
--- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/resource-timing/resource_timing.worker-expected.txt
+++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/resource-timing/resource_timing.worker-actual.txt
@@ -1,3 +1,5 @@
 
-PASS Performance Resource Entries in workers
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Performance Resource Entries in workers Test timed out
+

[Radar WebKit Bug Importer]

<rdar://problem/75586259>

[Robert Jenner]

Failures only occur on Apple Silicon Macs, and as such I cannot reproduce them because I do not have access to one.

[Eric Hutchison]

This test also appears to be flaky on Big Sur wk1 release Apple Silicon.

Reproduced the issue on arm64 r279472: run-webkit-test --root --iterations 500 --exit-after-n-failures 2 imported/w3c/web-platform-tests/resource-timing/resource_timing.worker.html 

I was unable to determine regression point for this test after testing with multiple spades.

[Eric Hutchison]

Created attachment 432742 [details]
Patch

[Eric Hutchison]

Created attachment 432746 [details]
Patch

[Eric Hutchison]

Created attachment 432750 [details]
Patch

[Eric Hutchison]

Created attachment 432804 [details]
Update Text Expectations

[Ryan Haddad]

Comment on attachment 432804 [details]
Update Text Expectations

Clearing flags on attachment: 432804

Committed r279507 (239359@main): <https://commits.webkit.org/239359@main>

[Eric Hutchison]

The test appeared to have been consistently timing out on wk1 until https://trac.webkit.org/changeset/278738/webkit, after which it became a flaky failure .

[Karl Rackler]

[ Monterey Release arm64 ] imported/w3c/web-platform-tests/resource-timing/resource_timing.worker.html is a flaky failure

Description:
imported/w3c/web-platform-tests/resource-timing/resource_timing.worker.html

There was not one commit that I observed causing this issue.  This test is flaky on Big Sur and Monterey Release wk1 and wk2.

The first failure that I saw on the dashboard was 3/17/2022 at r291447, but this does not appear relevant to causing this issue.

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fresource-timing%2Fresource_timing.worker.html&platform=mac&limit=50000

Diff:
--- /Volumes/Data/worker/monterey-release-applesilicon-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/resource-timing/resource_timing.worker-expected.txt
+++ /Volumes/Data/worker/monterey-release-applesilicon-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/resource-timing/resource_timing.worker-actual.txt
@@ -1,3 +1,5 @@
 
-PASS Performance Resource Entries in workers
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Performance Resource Entries in workers Test timed out
+

I have updated the test expectation [ macOS Release arm64 ] and marked this test as a flaky failure while this issue is investigated.

[Karl Rackler]

Pull request: https://github.com/WebKit/WebKit/pull/359

[EWS]

Committed r293221 (249890@main): <https://commits.webkit.org/249890@main>

Reviewed commits have been landed. Closing PR #359 and removing active labels.

[Karl Rackler]

Reopened because the issue is still being investigated.