Bug 235995 - REGRESSION(r288914): [ BigSur+ arm64 Release ] Bots are constantly exiting testing early with 500+ layout-test failures
Summary: REGRESSION(r288914): [ BigSur+ arm64 Release ] Bots are constantly exiting te...
Status: RESOLVED DUPLICATE of bug 235998
Alias: None
Product: WebKit
Classification: Unclassified
Component: Layout and Rendering (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-02-01 18:26 PST by Robert Jenner
Modified: 2022-02-05 19:11 PST (History)
6 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2022-02-01 18:26:36 PST
BigSur and Monterey Apple Silicon Release bots are constantly exiting testing early with 500+ layout-test failures. 

You can see this on the following four queues:
https://build.webkit.org/#/builders/Apple-Monterey-Release-AppleSilicon-WK2-Tests?numbuilds=50
https://build.webkit.org/#/builders/Apple-Monterey-Release-AppleSilicon-WK1-Tests?numbuilds=50
https://build.webkit.org/#/builders/Apple-BigSur-Release-AppleSilicon-WK2-Tests?numbuilds=50
https://build.webkit.org/#/builders/Apple-BigSur-Release-AppleSilicon-WK1-Tests?numbuilds=50

Here is a list of the test failures occurring:
https://build.webkit.org/results/Apple-Monterey-Release-AppleSilicon-WK2-Tests/r288925%20(1332)/results.html

They all appear to be tests that deal with layout and rendering, and they all have diffs that are just slightly off.
Comment 1 Radar WebKit Bug Importer 2022-02-01 18:28:04 PST
<rdar://problem/88358964>
Comment 2 Robert Jenner 2022-02-01 18:28:33 PST
I was able to reproduce the failures using the following test at Monterey Release ToT:

run-webkit-tests --no-build --no-show-results --no-new-test-results --clobber-old-results --exit-after-n-crashes-or-timeouts 50 --exit-after-n-failures 500 --release --debug-rwt-logging --no-retry-failures

I was able to reproduce the failures at r288914, but not at r288913. So it appears that r288914 is what broke testing on Apple Silicon.
Comment 3 Alexey Proskuryakov 2022-02-05 19:11:49 PST

*** This bug has been marked as a duplicate of bug 235998 ***