Bug 225430

Summary: [ BigSur wk2 arm64 ] http/tests/inspector/network/resource-sizes-network.html is a flakey text failure
Product: WebKit Reporter: Robert Jenner <jenner>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: ap, ben_schwartz, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Robert Jenner 2021-05-05 18:54:24 PDT
http/tests/inspector/network/resource-sizes-network.html

is a flakey text failure on BigSur in wk2 on Apple Silicon Macs only.

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Finspector%2Fnetwork%2Fresource-sizes-network.html

TEXT DIFF:
 PASS: responseSource should be Symbol(network).
 size: 2955
 requestBodyTransferSize: 0
-responseBodyTransferSize: 1239
-estimatedNetworkEncodedSize: 1239
-networkEncodedSize: 1239
+responseBodyTransferSize: 1229
+estimatedNetworkEncodedSize: 1229
+networkEncodedSize: 1229
 PASS: estimatedTotalTransferSize should be >= (encoded body size + headers).
 PASS: networkTotalTransferSize should be >= (encoded body size + headers).
 PASS: requestHeadersTransferSize should be non-empty.
Comment 1 Radar WebKit Bug Importer 2021-05-05 18:54:41 PDT
<rdar://problem/77587091>
Comment 2 Robert Jenner 2021-05-05 19:06:14 PDT
I cannot reproduce this failure, as it only occurs on Apple Silicon Macs, and I do not have access to one of those systems. 

The history indicates that the test has been flaky failing fairly close to when it started running on Apple Silicon Macs. 

As such, I have updated the expectations to flaky (Pass Failure) specifically for BigSur wk2 Apple Silicon Macs here:
https://trac.webkit.org/changeset/277066/webkit
Comment 3 Ben Schwartz 2023-09-12 14:58:44 PDT
Issue persists on macOS wk2 on arm64.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Finspector%2Fnetwork%2Fresource-sizes-network.html&platform=mac&architecture=arm64&flavor=wk2

TEXT DIFF:

 PASS: responseSource should be Symbol(network).
 size: 2955
 requestBodyTransferSize: 0
-responseBodyTransferSize: 1239
-estimatedNetworkEncodedSize: 1239
-networkEncodedSize: 1239
+responseBodyTransferSize: 1229
+estimatedNetworkEncodedSize: 1229
+networkEncodedSize: 1229
 PASS: estimatedTotalTransferSize should be >= (encoded body size + headers).
 PASS: networkTotalTransferSize should be >= (encoded body size + headers).
 PASS: requestHeadersTransferSize should be non-empty.

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Debug-AppleSilicon-WK2-Tests/267608@main%20(3539)/http/tests/inspector/network/resource-sizes-network-pretty-diff.html


Updating test expectations to reflect persisting issue.
Comment 4 Ben Schwartz 2023-09-12 16:27:49 PDT
REPRODUCIBILITY:

I was able to reproduce this issue on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-webkit-tests --no-build --no-show-results --no-new-test-results --clobber-old-results http/tests/inspector/network/resource-sizes-network.html --iterations 10000
Comment 5 EWS 2023-09-12 16:27:52 PDT
Test gardening commit 267925@main (a19c18631589): <https://commits.webkit.org/267925@main>

Reviewed commits have been landed. Closing PR #17713 and removing active labels.