NEW 281450
[EWS] API-Tests-iOS-Simulator-EWS: 11 tests in TestWebKitAPI.WebAuthenticationPanel are pre-existing API test failures 
https://bugs.webkit.org/show_bug.cgi?id=281450
Summary [EWS] API-Tests-iOS-Simulator-EWS: 11 tests in TestWebKitAPI.WebAuthenticatio...
Marta Darbinyan
Reported 2024-10-14 13:50:38 PDT
The following tests are failing in EWS as pre-existing API test failures. The tests are failing on EWS only. TestWebKitAPI.WebAuthenticationPanel.DeleteOneCredential TestWebKitAPI.WebAuthenticationPanel.ExportImportCredential TestWebKitAPI.WebAuthenticationPanel.ExportImportDuplicateCredential TestWebKitAPI.WebAuthenticationPanel.GetAllCredential TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialByCredentialID TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialByRPID TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialNullUserHandle TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialWithDisplayName TestWebKitAPI.WebAuthenticationPanel.GetAssertionLA TestWebKitAPI.WebAuthenticationPanel.UpdateCredentialDisplayName TestWebKitAPI.WebAuthenticationPanel.UpdateCredentialName Output logs: Failed TestWebKitAPI.WebAuthenticationPanel.DeleteOneCredential /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2411 Expected equality of these values: [credentials count] Which is: 2 0lu Which is: 0 TestWebKitAPI.WebAuthenticationPanel.ExportImportCredential /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2341 Expected equality of these values: [credentials count] Which is: 3 1lu Which is: 1 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2342 Expected equality of these values: [[_WKWebAuthenticationPanel getAllLocalAuthenticatorCredentialsWithAccessGroup:testWebKitAPIAlternateAccessGroup] count] Which is: 1 0lu Which is: 0 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2350 Expected equality of these values: [[_WKWebAuthenticationPanel getAllLocalAuthenticatorCredentialsWithAccessGroup:testWebKitAPIAccessGroup] count] Which is: 2 0lu Which is: 0 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2353 Expected equality of these values: [[credentials firstObject][_WKLocalAuthenticatorCredentialIDKey] base64EncodedStringWithOptions:0] Which is: "GB+ohyUvfbttigLbWCN9We8etUw=" [credentialId base64EncodedStringWithOptions:0] Which is: "" /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2355 Expected equality of these values: [[_WKWebAuthenticationPanel getAllLocalAuthenticatorCredentialsWithAccessGroup:testWebKitAPIAccessGroup] count] Which is: 2 0lu Which is: 0 TestWebKitAPI.WebAuthenticationPanel.ExportImportDuplicateCredential /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2369 Expected equality of these values: [credentials count] Which is: 3 1lu Which is: 1 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2380 Expected equality of these values: [credentials count] Which is: 2 1lu Which is: 1 TestWebKitAPI.WebAuthenticationPanel.GetAllCredential /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2109 Expected equality of these values: [credentials count] Which is: 3 1lu Which is: 1 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2112 Expected equality of these values: [credentials firstObject][_WKLocalAuthenticatorCredentialNameKey] Which is: "Something Different" "John" /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2113 Expected equality of these values: [[credentials firstObject][_WKLocalAuthenticatorCredentialIDKey] base64EncodedStringWithOptions:0] Which is: "GB+ohyUvfbttigLbWCN9We8etUw=" "SMSXHngF7hEOsElA73C3RY+8bR4=" /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2115 Expected equality of these values: [credentials firstObject][_WKLocalAuthenticatorCredentialRelyingPartyIDKey] Which is: "example2.com" "example.com" /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2117 Expected: ([[credentials firstObject][_WKLocalAuthenticatorCredentialLastModificationDateKey] compare:before.get()]) >= (0), actual: -1 vs 0 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2119 Expected equality of these values: [[credentials firstObject][_WKLocalAuthenticatorCredentialLastModificationDateKey] compare:[credentials firstObject][_WKLocalAuthenticatorCredentialCreationDateKey]] Which is: 1 0 TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialByCredentialID /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2203 Expected equality of these values: [credentials count] Which is: 3 1lu Which is: 1 TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialByRPID /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2171 Expected equality of these values: [credentials count] Which is: 3 1lu Which is: 1 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2173 Value of: addKeyToKeychain(testES256PrivateKeyBase64Alternate, "example2.com"_s, "o2JpZEoAAQIDBAUGBwgJZG5hbWVkSm9obmtkaXNwbGF5TmFtZWZKb2hubnk="_s) Actual: false Expected: true TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialNullUserHandle /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2134 Expected equality of these values: [credentials count] Which is: 4 1lu Which is: 1 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2137 Expected equality of these values: [credentials firstObject][_WKLocalAuthenticatorCredentialUserHandleKey] Which is: 0x600001e87000 [NSNull null] Which is: 0x1076d0590 TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialWithDisplayName /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2153 Expected equality of these values: [credentials count] Which is: 3 1lu Which is: 1 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2156 Expected equality of these values: [credentials firstObject][_WKLocalAuthenticatorCredentialNameKey] Which is: "Something Different" "John" /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2157 Expected equality of these values: [credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey] Which is: "Something Different" "Johnny" TestWebKitAPI.WebAuthenticationPanel.GetAssertionLA /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:1935 Expected equality of these values: [credentialsBefore count] Which is: 3 1lu Which is: 1 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:1937 Expected equality of these values: [[credentialsBefore firstObject][_WKLocalAuthenticatorCredentialLastModificationDateKey] compare:[credentialsBefore firstObject][_WKLocalAuthenticatorCredentialCreationDateKey]] Which is: 1 0 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:1938 Expected: ([[credentialsBefore firstObject][_WKLocalAuthenticatorCredentialLastModificationDateKey] compare:beforeTime.get()]) >= (0), actual: -1 vs 0 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:1956 Expected equality of these values: [credentialsAfter count] Which is: 3 1lu Which is: 1 TestWebKitAPI.WebAuthenticationPanel.UpdateCredentialDisplayName /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2266 Expected equality of these values: [credentials count] Which is: 3 1lu Which is: 1 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2269 Expected equality of these values: [credentials firstObject][_WKLocalAuthenticatorCredentialNameKey] Which is: "Something Different" "John" /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2270 Value of: !([credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey]) Actual: false Expected: true /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2276 Expected equality of these values: [credentials count] Which is: 3 1lu Which is: 1 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2279 Expected equality of these values: [credentials firstObject][_WKLocalAuthenticatorCredentialNameKey] Which is: "Something Different" "John" /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2286 Expected equality of these values: [credentials count] Which is: 3 1lu Which is: 1 TestWebKitAPI.WebAuthenticationPanel.UpdateCredentialName /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2303 Expected equality of these values: [credentials count] Which is: 3 1lu Which is: 1 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2306 Expected equality of these values: [credentials firstObject][_WKLocalAuthenticatorCredentialNameKey] Which is: "Something Different" "John" /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2307 Value of: !([credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey]) Actual: false Expected: true /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2313 Expected equality of these values: [credentials count] Which is: 3 1lu Which is: 1 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2316 Expected equality of these values: [credentials firstObject][_WKLocalAuthenticatorCredentialNameKey] Which is: "John" "Jill" /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2317 Value of: !([credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey]) Actual: false Expected: true /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2323 Expected equality of these values: [credentials count] Which is: 3 1lu Which is: 1 /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2327 Value of: !([credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey]) Actual: false Expected: true Testing completed, Exit status: 3 Link: https://ews-build.webkit.org/#/builders/13/builds/64898
Attachments
Add attachment proposed patch, testcase, etc.
Radar WebKit Bug Importer
Comment 1 2024-10-14 13:51:21 PDT
<rdar://problem/137902535>
Note You need to log in before you can comment on or make changes to this bug.