Bug 241438

Summary: [iOS] Four TestWebKitAPI.PrivateClickMeasurement tests are flaky failures/timeouts
Product: WebKit Reporter: Ryan Haddad <ryanhaddad>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: achristensen, webkit-bot-watchers-bugzilla, webkit-bug-importer, wilander
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Ryan Haddad 2022-06-08 14:53:34 PDT
The following API tests are flaky on iOS bots

TestWebKitAPI.PrivateClickMeasurement.InvalidBlindedSecret
TestWebKitAPI.PrivateClickMeasurement.ValidBlindedSecret
TestWebKitAPI.PrivateClickMeasurement.DestinationClickFraudPrevention
TestWebKitAPI.PrivateClickMeasurement.SourceClickFraudPrevention



These two are flaky failures with the following output:

TestWebKitAPI.PrivateClickMeasurement.InvalidBlindedSecret
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/PrivateClickMeasurement.cpp:326
        Value of: errorMessage
          Actual: true
        Expected: false
        
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/PrivateClickMeasurement.cpp:328
        Expected equality of these values:
          sourceUnlinkableToken->asObject()->size()
            Which is: 0
          4ul
            Which is: 4
        
    TestWebKitAPI.PrivateClickMeasurement.ValidBlindedSecret
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:79
        Value of: errorMessage
          Actual: true
        Expected: false
        
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:82
        Expected equality of these values:
          sourceUnlinkableToken->asObject()->size()
            Which is: 0
          4ul
            Which is: 4
        
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:83
        Expected equality of these values:
          sourceUnlinkableToken->getString("source_engagement_type"_s).utf8().data()
            Which is: ""
          "click"
        
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:84
        Expected equality of these values:
          sourceUnlinkableToken->getString("source_nonce"_s).utf8().data()
            Which is: ""
          "ABCDEFabcdef0123456789"
        
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:85
        Value of: sourceUnlinkableToken->getString("source_unlinkable_token"_s).isEmpty()
          Actual: true
        Expected: false
        
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:86
        Expected equality of these values:
          sourceUnlinkableToken->getInteger("version"_s)
            Which is: (nullopt)
          3
        
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:96
        Value of: errorMessage
          Actual: true
        Expected: false
        
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:98
        Value of: persistentToken
          Actual: false
        Expected: true
        
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:99
        Value of: persistentToken->tokenBase64URL.isEmpty()
          Actual: true
        Expected: false
        
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:101
        Value of: persistentToken->signatureBase64URL.isEmpty()
          Actual: true
        Expected: false

These two are flaky timeouts:
TestWebKitAPI.PrivateClickMeasurement.DestinationClickFraudPrevention
TestWebKitAPI.PrivateClickMeasurement.SourceClickFraudPrevention


https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.PrivateClickMeasurement.InvalidBlindedSecret&test=TestWebKitAPI.PrivateClickMeasurement.ValidBlindedSecret&test=TestWebKitAPI.PrivateClickMeasurement.DestinationClickFraudPrevention&test=TestWebKitAPI.PrivateClickMeasurement.SourceClickFraudPrevention
Comment 1 Radar WebKit Bug Importer 2022-06-08 14:54:44 PDT
<rdar://problem/94667905>