241438 2022-06-08 14:53:34 -0700 [iOS] Four TestWebKitAPI.PrivateClickMeasurement tests are flaky failures/timeouts 2022-06-08 14:54:44 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified NEW InRadar P2 Normal --- 1 ryanhaddad webkit-unassigned achristensen webkit-bot-watchers-bugzilla webkit-bug-importer wilander oldest_to_newest 1874820 0 ryanhaddad 2022-06-08 14:53:34 -0700 The following API tests are flaky on iOS bots TestWebKitAPI.PrivateClickMeasurement.InvalidBlindedSecret TestWebKitAPI.PrivateClickMeasurement.ValidBlindedSecret TestWebKitAPI.PrivateClickMeasurement.DestinationClickFraudPrevention TestWebKitAPI.PrivateClickMeasurement.SourceClickFraudPrevention These two are flaky failures with the following output: TestWebKitAPI.PrivateClickMeasurement.InvalidBlindedSecret /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/PrivateClickMeasurement.cpp:326 Value of: errorMessage Actual: true Expected: false /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/PrivateClickMeasurement.cpp:328 Expected equality of these values: sourceUnlinkableToken->asObject()->size() Which is: 0 4ul Which is: 4 TestWebKitAPI.PrivateClickMeasurement.ValidBlindedSecret /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:79 Value of: errorMessage Actual: true Expected: false /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:82 Expected equality of these values: sourceUnlinkableToken->asObject()->size() Which is: 0 4ul Which is: 4 /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:83 Expected equality of these values: sourceUnlinkableToken->getString("source_engagement_type"_s).utf8().data() Which is: "" "click" /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:84 Expected equality of these values: sourceUnlinkableToken->getString("source_nonce"_s).utf8().data() Which is: "" "ABCDEFabcdef0123456789" /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:85 Value of: sourceUnlinkableToken->getString("source_unlinkable_token"_s).isEmpty() Actual: true Expected: false /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:86 Expected equality of these values: sourceUnlinkableToken->getInteger("version"_s) Which is: (nullopt) 3 /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:96 Value of: errorMessage Actual: true Expected: false /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:98 Value of: persistentToken Actual: false Expected: true /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:99 Value of: persistentToken->tokenBase64URL.isEmpty() Actual: true Expected: false /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:101 Value of: persistentToken->signatureBase64URL.isEmpty() Actual: true Expected: false These two are flaky timeouts: TestWebKitAPI.PrivateClickMeasurement.DestinationClickFraudPrevention TestWebKitAPI.PrivateClickMeasurement.SourceClickFraudPrevention https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.PrivateClickMeasurement.InvalidBlindedSecret&test=TestWebKitAPI.PrivateClickMeasurement.ValidBlindedSecret&test=TestWebKitAPI.PrivateClickMeasurement.DestinationClickFraudPrevention&test=TestWebKitAPI.PrivateClickMeasurement.SourceClickFraudPrevention 1874821 1 webkit-bug-importer 2022-06-08 14:54:44 -0700 <rdar://problem/94667905>