Bug 266102

Summary:	NEW-TEST(271524@main): [ macOS ] TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants is a flaky failure
Product:	WebKit	Reporter:	Robert Jenner <jenner>
Component:	Text	Assignee:	Robert Jenner <jenner>
Status:	NEW ---
Severity:	Normal	CC:	fantasai.bugs, mmaxfield, vitor.roriz, webkit-bot-watchers-bugzilla, webkit-bug-importer, ysuzuki
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Robert Jenner 2023-12-08 14:08:26 PST

TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants

is a flaky failing API test on macOS. It's very flaky on one Ventura Intel queue, but it's near constant on apple silicon queues running Monterey and up. It appears to have been introduced recently at https://commits.webkit.org/271524@main, and has been in this reported state since.

HISTORY:
https://results.webkit.org/?suite=api-tests&test=TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants

STDIO FAIL TXT:
TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants
        /Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16EXCEEDED LOG LINE THRESHOLD OF 250

Comment 1 Radar WebKit Bug Importer 2023-12-08 14:09:42 PST

<rdar://problem/119399924>

Comment 2 Robert Jenner 2023-12-08 14:43:48 PST

This test is also failing on EWS observed here:
https://ews-build.webkit.org/#/builders/18

And the PR for the commit that introduced this test was landed before it ran on EWS api-mac observed here:
https://github.com/WebKit/WebKit/pull/21266

So that's why this failure was not caught by EWS. 

I was unable to reproduce this locally on my apple silicon Mac running macOS Sonoma 14.1. But since it is having an impact on EWS, I am going to disable it until it can be looked at.

Comment 3 Robert Jenner 2023-12-08 15:01:11 PST

Pull request: https://github.com/WebKit/WebKit/pull/21538

Comment 4 EWS 2023-12-08 16:12:35 PST

Test gardening commit 271767@main (62e7362b103f): <https://commits.webkit.org/271767@main>

Reviewed commits have been landed. Closing PR #21538 and removing active labels.