Bug 234609 - REGRESSION: TestWebKitAPI.PublicSuffix.IsPublicSuffix is failing on some bots
Summary: REGRESSION: TestWebKitAPI.PublicSuffix.IsPublicSuffix is failing on some bots
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-12-22 09:58 PST by Ryan Haddad
Modified: 2022-01-07 11:56 PST (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2021-12-22 09:58:40 PST
TestWebKitAPI.PublicSuffix.IsPublicSuffix is failing on some, but not all bots.

It started failing on the x86 iOS GPUP bot on 12/14/2021 @ r287056.
It then started failing on the arm64 iOS GPUP bot on 12/16/2021 @ r287127, and then the rest of the non-GPUP iOS bots on 12/17/2021 @ 287217.

One of the Catalina Release bots started failing the test on 12/19/2021 @ r287237.

    TestWebKitAPI.PublicSuffix.IsPublicSuffix
        
        /Volumes/Data/worker/ios-simulator-15-release/build/Tools/TestWebKitAPI/Tests/WebCore/PublicSuffix.cpp:85
        Value of: isPublicSuffix("example")
          Actual: true
        Expected: false

https://results.webkit.org/?suite=api-tests&test=TestWebKitAPI.PublicSuffix.IsPublicSuffix
Comment 1 Radar WebKit Bug Importer 2021-12-22 10:03:44 PST
<rdar://problem/86815794>
Comment 2 Ryan Haddad 2022-01-05 15:29:05 PST
The test started failing on almost all bots (except Big Sur arm64?) at r287443, which itself seems unrelated.
Comment 3 Ryan Haddad 2022-01-07 09:46:44 PST
I just built debug locally and I was able to reproduce this on the first try.
Comment 4 Ryan Haddad 2022-01-07 11:56:56 PST
Disabled the failing subtest in r287773 to let the bots have a chance of being green.