Bug 266102

Summary:	NEW-TEST(271524@main): [ macOS ] TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants is a flaky failure
Product:	WebKit	Reporter:	Robert Jenner <jenner>
Component:	Text	Assignee:	Robert Jenner <jenner>
Status:	NEW
Severity:	Normal	CC:	fantasai.bugs, mmaxfield, vitor.roriz, webkit-bot-watchers-bugzilla, webkit-bug-importer, ysuzuki
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Robert Jenner

Reported 2023-12-08 14:08:26 PST

TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants is a flaky failing API test on macOS. It's very flaky on one Ventura Intel queue, but it's near constant on apple silicon queues running Monterey and up. It appears to have been introduced recently at https://commits.webkit.org/271524@main, and has been in this reported state since. HISTORY: https://results.webkit.org/?suite=api-tests&test=TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants STDIO FAIL TXT: TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants /Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16 width Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values: originalWidth Which is: 16EXCEEDED LOG LINE THRESHOLD OF 250

Attachments
Add attachment proposed patch, testcase, etc.

Radar WebKit Bug Importer

Comment 1 2023-12-08 14:09:42 PST

<rdar://problem/119399924>

Robert Jenner

Comment 2 2023-12-08 14:43:48 PST

This test is also failing on EWS observed here: https://ews-build.webkit.org/#/builders/18 And the PR for the commit that introduced this test was landed before it ran on EWS api-mac observed here: https://github.com/WebKit/WebKit/pull/21266 So that's why this failure was not caught by EWS. I was unable to reproduce this locally on my apple silicon Mac running macOS Sonoma 14.1. But since it is having an impact on EWS, I am going to disable it until it can be looked at.

Robert Jenner

Comment 3 2023-12-08 15:01:11 PST

Pull request: https://github.com/WebKit/WebKit/pull/21538

EWS

Comment 4 2023-12-08 16:12:35 PST

Test gardening commit 271767@main (62e7362b103f): <https://commits.webkit.org/271767@main> Reviewed commits have been landed. Closing PR #21538 and removing active labels.

Note You need to log in before you can comment on or make changes to this bug.