Bug 266102 - NEW-TEST(271524@main): [ macOS ] TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants is a flaky failure
Summary: NEW-TEST(271524@main): [ macOS ] TestWebKitAPI.MonospaceFontsTest.EnsureMonos...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Text (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Robert Jenner
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-12-08 14:08 PST by Robert Jenner
Modified: 2023-12-11 13:10 PST (History)
6 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2023-12-08 14:08:26 PST
TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants

is a flaky failing API test on macOS. It's very flaky on one Ventura Intel queue, but it's near constant on apple silicon queues running Monterey and up. It appears to have been introduced recently at https://commits.webkit.org/271524@main, and has been in this reported state since.

HISTORY:
https://results.webkit.org/?suite=api-tests&test=TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants

STDIO FAIL TXT:
TestWebKitAPI.MonospaceFontsTest.EnsureMonospaceFontInvariants
        /Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16  width    Which is: 8/Volumes/Data/worker/Apple-Sonoma-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/MonospaceFontTests.cpp:67Expected equality of these values:  originalWidth    Which is: 16EXCEEDED LOG LINE THRESHOLD OF 250
Comment 1 Radar WebKit Bug Importer 2023-12-08 14:09:42 PST
<rdar://problem/119399924>
Comment 2 Robert Jenner 2023-12-08 14:43:48 PST
This test is also failing on EWS observed here:
https://ews-build.webkit.org/#/builders/18

And the PR for the commit that introduced this test was landed before it ran on EWS api-mac observed here:
https://github.com/WebKit/WebKit/pull/21266

So that's why this failure was not caught by EWS. 

I was unable to reproduce this locally on my apple silicon Mac running macOS Sonoma 14.1. But since it is having an impact on EWS, I am going to disable it until it can be looked at.
Comment 3 Robert Jenner 2023-12-08 15:01:11 PST
Pull request: https://github.com/WebKit/WebKit/pull/21538
Comment 4 EWS 2023-12-08 16:12:35 PST
Test gardening commit 271767@main (62e7362b103f): <https://commits.webkit.org/271767@main>

Reviewed commits have been landed. Closing PR #21538 and removing active labels.