Bug 266102 – NEW-TEST(271524@main): [ macOS ] TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants is a flaky failure

• Status: NEW
• Component: Text

[Robert Jenner]

TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants

is a flaky failing API test on macOS. It's very flaky on one Ventura Intel queue, but it's near constant on apple silicon queues running Monterey and up. It appears to have been introduced recently at https://commits.webkit.org/271524@main, and has been in this reported state since.

HISTORY:
https://results.webkit.org/?suite=api-tests&test=TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants

STDIO FAIL TXT:
TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants
        /Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16EXCEEDED LOG LINE THRESHOLD OF 250

[Radar WebKit Bug Importer]

<rdar://problem/119399924>

[Robert Jenner]

This test is also failing on EWS observed here:
https://ews-build.webkit.org/#/builders/18

And the PR for the commit that introduced this test was landed before it ran on EWS api-mac observed here:
https://github.com/WebKit/WebKit/pull/21266

So that's why this failure was not caught by EWS. 

I was unable to reproduce this locally on my apple silicon Mac running macOS Sonoma 14.1. But since it is having an impact on EWS, I am going to disable it until it can be looked at.

[Robert Jenner]

Pull request: https://github.com/WebKit/WebKit/pull/21538

[EWS]

Test gardening commit 271767@main (62e7362b103f): <https://commits.webkit.org/271767@main>

Reviewed commits have been landed. Closing PR #21538 and removing active labels.