Bug 268040 – New Test (204015@main?): 6 imported/w3c/web-platform-tests/xhr/* layout tests are flakily failing.

• Status: NEW
• Component: Tools / Tests

[Ben Schwartz]

The following tests are flakily failing on all platforms across WK1 and WK2:

imported/w3c/web-platform-tests/xhr/event-upload-progress.any.html
imported/w3c/web-platform-tests/xhr/event-upload-progress.any.worker.html
imported/w3c/web-platform-tests/xhr/request-content-length.any.html
imported/w3c/web-platform-tests/xhr/request-content-length.any.worker.html
imported/w3c/web-platform-tests/xhr/send-response-event-order.htm
imported/w3c/web-platform-tests/xhr/send-response-upload-event-loadend.htm

HISTORY:

https://results.webkit.org/?version_name=Monterey&version_name=Ventura&version_name=Sonoma&version_name=iOS%2017&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fxhr%2Fevent-upload-progress.any.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fxhr%2Fevent-upload-progress.any.worker.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fxhr%2Frequest-content-length.any.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fxhr%2Frequest-content-length.any.worker.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fxhr%2Fsend-response-event-order.htm&test=imported%2Fw3c%2Fweb-platform-tests%2Fxhr%2Fsend-response-upload-event-loadend.htm

TEXT DIFFs:

Attached.

DIFF URL:

https://build.webkit.org/results/Apple-iPadOS-17-Simulator-Release-WK2-Tests/273434@main%20(808)/imported/w3c/web-platform-tests/xhr/event-upload-progress.any-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this issue on macOS Sonoma (14.3, 23D56/arm64) ToT using the following command:

run-webkit-tests -v -1 --debug imported/w3c/web-platform-tests/xhr/event-upload-progress.any.html --child-processes 10 --iterations 1000 -f --exit-after-n-failures 1

(for the last test, iterations must be changed from 1000 to 10000)

REGRESSION:

Contextual information indicates that this may have been a problem since these tests were introduced at 204015@main.

[Ben Schwartz]

<rdar://problem/92818673>

[Ben Schwartz]

Created attachment 469538 [details]
Test results.

[Ben Schwartz]

ALL DIFF LINKS:

https://build.webkit.org/results/Apple-iPadOS-17-Simulator-Release-WK2-Tests/273434@main%20(808)/imported/w3c/web-platform-tests/xhr/event-upload-progress.any-pretty-diff.html
https://build.webkit.org/results/Apple-Sonoma-Debug-WK2-Tests/273416@main%20(800)/imported/w3c/web-platform-tests/xhr/event-upload-progress.any.worker-pretty-diff.html
https://build.webkit.org/results/Apple-Monterey-Debug-AppleSilicon-WK1-Tests/273437@main%20(10020)/imported/w3c/web-platform-tests/xhr/request-content-length.any-pretty-diff.html
https://build.webkit.org/results/Apple-Monterey-Release-AppleSilicon-WK1-Tests/273441@main%20(14812)/imported/w3c/web-platform-tests/xhr/request-content-length.any.worker-pretty-diff.html
https://build.webkit.org/results/Apple-Monterey-Debug-WK1-Tests/273337@main%20(8713)/imported/w3c/web-platform-tests/xhr/send-response-event-order-pretty-diff.html
https://build.webkit.org/results/Apple-Sonoma-Debug-AppleSilicon-WK1-Tests/273386@main%20(1363)/imported/w3c/web-platform-tests/xhr/send-response-upload-event-loadend-pretty-diff.html