Bug 225430 - [ BigSur wk2 arm64 ] http/tests/inspector/network/resource-sizes-network.html is a flakey text failure
Summary: [ BigSur wk2 arm64 ] http/tests/inspector/network/resource-sizes-network.html...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-05-05 18:54 PDT by Robert Jenner
Modified: 2023-09-12 16:27 PDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2021-05-05 18:54:24 PDT
http/tests/inspector/network/resource-sizes-network.html

is a flakey text failure on BigSur in wk2 on Apple Silicon Macs only.

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Finspector%2Fnetwork%2Fresource-sizes-network.html

TEXT DIFF:
 PASS: responseSource should be Symbol(network).
 size: 2955
 requestBodyTransferSize: 0
-responseBodyTransferSize: 1239
-estimatedNetworkEncodedSize: 1239
-networkEncodedSize: 1239
+responseBodyTransferSize: 1229
+estimatedNetworkEncodedSize: 1229
+networkEncodedSize: 1229
 PASS: estimatedTotalTransferSize should be >= (encoded body size + headers).
 PASS: networkTotalTransferSize should be >= (encoded body size + headers).
 PASS: requestHeadersTransferSize should be non-empty.
Comment 1 Radar WebKit Bug Importer 2021-05-05 18:54:41 PDT
<rdar://problem/77587091>
Comment 2 Robert Jenner 2021-05-05 19:06:14 PDT
I cannot reproduce this failure, as it only occurs on Apple Silicon Macs, and I do not have access to one of those systems. 

The history indicates that the test has been flaky failing fairly close to when it started running on Apple Silicon Macs. 

As such, I have updated the expectations to flaky (Pass Failure) specifically for BigSur wk2 Apple Silicon Macs here:
https://trac.webkit.org/changeset/277066/webkit
Comment 3 Ben Schwartz 2023-09-12 14:58:44 PDT
Issue persists on macOS wk2 on arm64.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Finspector%2Fnetwork%2Fresource-sizes-network.html&platform=mac&architecture=arm64&flavor=wk2

TEXT DIFF:

 PASS: responseSource should be Symbol(network).
 size: 2955
 requestBodyTransferSize: 0
-responseBodyTransferSize: 1239
-estimatedNetworkEncodedSize: 1239
-networkEncodedSize: 1239
+responseBodyTransferSize: 1229
+estimatedNetworkEncodedSize: 1229
+networkEncodedSize: 1229
 PASS: estimatedTotalTransferSize should be >= (encoded body size + headers).
 PASS: networkTotalTransferSize should be >= (encoded body size + headers).
 PASS: requestHeadersTransferSize should be non-empty.

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Debug-AppleSilicon-WK2-Tests/267608@main%20(3539)/http/tests/inspector/network/resource-sizes-network-pretty-diff.html


Updating test expectations to reflect persisting issue.
Comment 4 Ben Schwartz 2023-09-12 16:27:49 PDT
REPRODUCIBILITY:

I was able to reproduce this issue on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-webkit-tests --no-build --no-show-results --no-new-test-results --clobber-old-results http/tests/inspector/network/resource-sizes-network.html --iterations 10000
Comment 5 EWS 2023-09-12 16:27:52 PDT
Test gardening commit 267925@main (a19c18631589): <https://commits.webkit.org/267925@main>

Reviewed commits have been landed. Closing PR #17713 and removing active labels.