Bug 223472 - [ BigSur Release Arm64 ] imported/w3c/web-platform-tests/resource-timing/resource_timing.worker.html is a flakey text failure
Summary: [ BigSur Release Arm64 ] imported/w3c/web-platform-tests/resource-timing/reso...
Status: REOPENED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Karl Rackler
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-03-18 12:53 PDT by Robert Jenner
Modified: 2022-04-22 08:15 PDT (History)
8 users (show)

See Also:


Attachments
Patch (1.43 KB, patch)
2021-07-01 16:19 PDT, Eric Hutchison
no flags Details | Formatted Diff | Diff
Patch (2.04 KB, patch)
2021-07-01 16:45 PDT, Eric Hutchison
no flags Details | Formatted Diff | Diff
Patch (1.44 KB, patch)
2021-07-01 17:06 PDT, Eric Hutchison
no flags Details | Formatted Diff | Diff
Update Text Expectations (2.49 KB, patch)
2021-07-02 10:40 PDT, Eric Hutchison
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2021-03-18 12:53:17 PDT
imported/w3c/web-platform-tests/resource-timing/resource_timing.worker.html

is a flakey text failure in macOS BigSur release wk2 on Apple Silicon only. 


https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fresource-timing%2Fresource_timing.worker.html


TEXT DIFF:
--- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/resource-timing/resource_timing.worker-expected.txt
+++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/resource-timing/resource_timing.worker-actual.txt
@@ -1,3 +1,5 @@
 
-PASS Performance Resource Entries in workers
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Performance Resource Entries in workers Test timed out
+
Comment 1 Radar WebKit Bug Importer 2021-03-18 12:53:38 PDT
<rdar://problem/75586259>
Comment 2 Robert Jenner 2021-03-18 13:01:41 PDT
Failures only occur on Apple Silicon Macs, and as such I cannot reproduce them because I do not have access to one.
Comment 3 Eric Hutchison 2021-07-01 15:58:02 PDT
This test also appears to be flaky on Big Sur wk1 release Apple Silicon.

Reproduced the issue on arm64 r279472: run-webkit-test --root --iterations 500 --exit-after-n-failures 2 imported/w3c/web-platform-tests/resource-timing/resource_timing.worker.html 

I was unable to determine regression point for this test after testing with multiple spades.
Comment 4 Eric Hutchison 2021-07-01 16:19:11 PDT
Created attachment 432742 [details]
Patch
Comment 5 Eric Hutchison 2021-07-01 16:45:32 PDT
Created attachment 432746 [details]
Patch
Comment 6 Eric Hutchison 2021-07-01 17:06:25 PDT
Created attachment 432750 [details]
Patch
Comment 7 Eric Hutchison 2021-07-02 10:40:00 PDT
Created attachment 432804 [details]
Update Text Expectations
Comment 8 Ryan Haddad 2021-07-02 10:41:38 PDT
Comment on attachment 432804 [details]
Update Text Expectations

Clearing flags on attachment: 432804

Committed r279507 (239359@main): <https://commits.webkit.org/239359@main>
Comment 9 Eric Hutchison 2021-07-02 10:48:34 PDT
The test appeared to have been consistently timing out on wk1 until https://trac.webkit.org/changeset/278738/webkit, after which it became a flaky failure .
Comment 10 Karl Rackler 2022-04-22 08:09:04 PDT
[ Monterey Release arm64 ] imported/w3c/web-platform-tests/resource-timing/resource_timing.worker.html is a flaky failure

Description:
imported/w3c/web-platform-tests/resource-timing/resource_timing.worker.html

There was not one commit that I observed causing this issue.  This test is flaky on Big Sur and Monterey Release wk1 and wk2.

The first failure that I saw on the dashboard was 3/17/2022 at r291447, but this does not appear relevant to causing this issue.

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fresource-timing%2Fresource_timing.worker.html&platform=mac&limit=50000

Diff:
--- /Volumes/Data/worker/monterey-release-applesilicon-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/resource-timing/resource_timing.worker-expected.txt
+++ /Volumes/Data/worker/monterey-release-applesilicon-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/resource-timing/resource_timing.worker-actual.txt
@@ -1,3 +1,5 @@
 
-PASS Performance Resource Entries in workers
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Performance Resource Entries in workers Test timed out
+

I have updated the test expectation [ macOS Release arm64 ] and marked this test as a flaky failure while this issue is investigated.
Comment 11 Karl Rackler 2022-04-22 08:10:45 PDT
Pull request: https://github.com/WebKit/WebKit/pull/359
Comment 12 EWS 2022-04-22 08:14:30 PDT
Committed r293221 (249890@main): <https://commits.webkit.org/249890@main>

Reviewed commits have been landed. Closing PR #359 and removing active labels.
Comment 13 Karl Rackler 2022-04-22 08:15:21 PDT
Reopened because the issue is still being investigated.