Bug 241438
| Summary: | [iOS] Four TestWebKitAPI.PrivateClickMeasurement tests are flaky failures/timeouts | ||
|---|---|---|---|
| Product: | WebKit | Reporter: | Ryan Haddad <ryanhaddad> |
| Component: | New Bugs | Assignee: | Nobody <webkit-unassigned> |
| Status: | NEW | ||
| Severity: | Normal | CC: | achristensen, webkit-bot-watchers-bugzilla, webkit-bug-importer, wilander |
| Priority: | P2 | Keywords: | InRadar |
| Version: | WebKit Nightly Build | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
Ryan Haddad
The following API tests are flaky on iOS bots
TestWebKitAPI.PrivateClickMeasurement.InvalidBlindedSecret
TestWebKitAPI.PrivateClickMeasurement.ValidBlindedSecret
TestWebKitAPI.PrivateClickMeasurement.DestinationClickFraudPrevention
TestWebKitAPI.PrivateClickMeasurement.SourceClickFraudPrevention
These two are flaky failures with the following output:
TestWebKitAPI.PrivateClickMeasurement.InvalidBlindedSecret
/Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/PrivateClickMeasurement.cpp:326
Value of: errorMessage
Actual: true
Expected: false
/Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/PrivateClickMeasurement.cpp:328
Expected equality of these values:
sourceUnlinkableToken->asObject()->size()
Which is: 0
4ul
Which is: 4
TestWebKitAPI.PrivateClickMeasurement.ValidBlindedSecret
/Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:79
Value of: errorMessage
Actual: true
Expected: false
/Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:82
Expected equality of these values:
sourceUnlinkableToken->asObject()->size()
Which is: 0
4ul
Which is: 4
/Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:83
Expected equality of these values:
sourceUnlinkableToken->getString("source_engagement_type"_s).utf8().data()
Which is: ""
"click"
/Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:84
Expected equality of these values:
sourceUnlinkableToken->getString("source_nonce"_s).utf8().data()
Which is: ""
"ABCDEFabcdef0123456789"
/Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:85
Value of: sourceUnlinkableToken->getString("source_unlinkable_token"_s).isEmpty()
Actual: true
Expected: false
/Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:86
Expected equality of these values:
sourceUnlinkableToken->getInteger("version"_s)
Which is: (nullopt)
3
/Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:96
Value of: errorMessage
Actual: true
Expected: false
/Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:98
Value of: persistentToken
Actual: false
Expected: true
/Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:99
Value of: persistentToken->tokenBase64URL.isEmpty()
Actual: true
Expected: false
/Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebCore/cocoa/PrivateClickMeasurementCocoa.mm:101
Value of: persistentToken->signatureBase64URL.isEmpty()
Actual: true
Expected: false
These two are flaky timeouts:
TestWebKitAPI.PrivateClickMeasurement.DestinationClickFraudPrevention
TestWebKitAPI.PrivateClickMeasurement.SourceClickFraudPrevention
https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.PrivateClickMeasurement.InvalidBlindedSecret&test=TestWebKitAPI.PrivateClickMeasurement.ValidBlindedSecret&test=TestWebKitAPI.PrivateClickMeasurement.DestinationClickFraudPrevention&test=TestWebKitAPI.PrivateClickMeasurement.SourceClickFraudPrevention
| Attachments | ||
|---|---|---|
| Add attachment proposed patch, testcase, etc. |
Radar WebKit Bug Importer
<rdar://problem/94667905>