NEW 241438
[iOS] Four TestWebKitAPI.PrivateClickMeasurement tests are flaky failures/timeouts
https://bugs.webkit.org/show_bug.cgi?id=241438
Summary [iOS] Four TestWebKitAPI.PrivateClickMeasurement tests are flaky failures/tim...
Ryan Haddad
Reported 2022-06-08 14:53:34 PDT
The following API tests are flaky on iOS bots TestWebKitAPI.PrivateClickMeasurement.InvalidBlindedSecret TestWebKitAPI.PrivateClickMeasurement.ValidBlindedSecret TestWebKitAPI.PrivateClickMeasurement.DestinationClickFraudPrevention TestWebKitAPI.PrivateClickMeasurement.SourceClickFraudPrevention These two are flaky failures with the following output: TestWebKitAPI.PrivateClickMeasurement.InvalidBlindedSecret /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/PrivateClickMeasurement.cpp:326 Value of: errorMessage Actual: true Expected: false /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/PrivateClickMeasurement.cpp:328 Expected equality of these values: sourceUnlinkableToken->asObject()->size() Which is: 0 4ul Which is: 4 TestWebKitAPI.PrivateClickMeasurement.ValidBlindedSecret /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:79 Value of: errorMessage Actual: true Expected: false /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:82 Expected equality of these values: sourceUnlinkableToken->asObject()->size() Which is: 0 4ul Which is: 4 /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:83 Expected equality of these values: sourceUnlinkableToken->getString("source_engagement_type"_s).utf8().data() Which is: "" "click" /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:84 Expected equality of these values: sourceUnlinkableToken->getString("source_nonce"_s).utf8().data() Which is: "" "ABCDEFabcdef0123456789" /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:85 Value of: sourceUnlinkableToken->getString("source_unlinkable_token"_s).isEmpty() Actual: true Expected: false /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:86 Expected equality of these values: sourceUnlinkableToken->getInteger("version"_s) Which is: (nullopt) 3 /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:96 Value of: errorMessage Actual: true Expected: false /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:98 Value of: persistentToken Actual: false Expected: true /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:99 Value of: persistentToken->tokenBase64URL.isEmpty() Actual: true Expected: false /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:101 Value of: persistentToken->signatureBase64URL.isEmpty() Actual: true Expected: false These two are flaky timeouts: TestWebKitAPI.PrivateClickMeasurement.DestinationClickFraudPrevention TestWebKitAPI.PrivateClickMeasurement.SourceClickFraudPrevention https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.PrivateClickMeasurement.InvalidBlindedSecret&test=TestWebKitAPI.PrivateClickMeasurement.ValidBlindedSecret&test=TestWebKitAPI.PrivateClickMeasurement.DestinationClickFraudPrevention&test=TestWebKitAPI.PrivateClickMeasurement.SourceClickFraudPrevention
Attachments
Radar WebKit Bug Importer
Comment 1 2022-06-08 14:54:44 PDT
Note You need to log in before you can comment on or make changes to this bug.