277432 2024-07-31 10:35:29 -0700 REGRESSION (281139@main): [ Ventura iOS18 ] 2 WebCrypto layout tests failing after CryptoKit enablement. 2024-08-05 09:39:15 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 ben_schwartz nitinmahendru nitinmahendru webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 2049855 0 ben_schwartz 2024-07-31 10:35:29 -0700 The following two tests are constantly failing on macOS Ventura and iOS 18: imported/w3c/web-platform-tests/WebCryptoAPI/import_export/ec_importKey.https.any.html imported/w3c/web-platform-tests/WebCryptoAPI/import_export/ec_importKey.https.any.worker.html HISTORY: https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2FWebCryptoAPI%2Fimport_export%2Fec_importKey.https.any.html&test=imported%2Fw3c%2Fweb-platform-tests%2FWebCryptoAPI%2Fimport_export%2Fec_importKey.https.any.worker.html TEXT DIFFs: PASS Good parameters: P-256 bits (spki, buffer(91), {name: ECDSA, namedCurve: P-256}, true, [verify]) -PASS Good parameters: P-256 bits (spki, buffer(59, compressed), {name: ECDSA, namedCurve: P-256}, true, [verify]) +FAIL Good parameters: P-256 bits (spki, buffer(59, compressed), {name: ECDSA, namedCurve: P-256}, true, [verify]) assert_true: Round trip works expected true got false PASS Good parameters: P-256 bits (jwk, object(kty, crv, x, y), {name: ECDSA, namedCurve: P-256}, true, [verify]) PASS Good parameters: P-256 bits (raw, buffer(65), {name: ECDSA, namedCurve: P-256}, true, [verify]) NOTRUN Good parameters: P-256 bits (raw, buffer(33, compressed), {name: ECDSA, namedCurve: P-256}, true, [verify]) Compressed point format not supported: DataError: Data provided to an operation does not meet requirements PASS Good parameters: P-256 bits (spki, buffer(91), {name: ECDSA, namedCurve: P-256}, true, []) -PASS Good parameters: P-256 bits (spki, buffer(59, compressed), {name: ECDSA, namedCurve: P-256}, true, []) +FAIL Good parameters: P-256 bits (spki, buffer(59, compressed), {name: ECDSA, namedCurve: P-256}, true, []) assert_true: Round trip works expected true got false PASS Good parameters: P-256 bits (jwk, object(kty, crv, x, y), {name: ECDSA, namedCurve: P-256}, true, []) PASS Good parameters: P-256 bits (raw, buffer(65), {name: ECDSA, namedCurve: P-256}, true, []) NOTRUN Good parameters: P-256 bits (raw, buffer(33, compressed), {name: ECDSA, namedCurve: P-256}, true, []) Compressed point format not supported: DataError: Data provided to an operation does not meet requirements PASS Good parameters: P-256 bits (spki, buffer(91), {name: ECDSA, namedCurve: P-256}, true, [verify, verify]) -PASS Good parameters: P-256 bits (spki, buffer(59, compressed), {name: ECDSA, namedCurve: P-256}, true, [verify, verify]) +FAIL Good parameters: P-256 bits (spki, buffer(59, compressed), {name: ECDSA, namedCurve: P-256}, true, [verify, verify]) assert_true: Round trip works expected true got false PASS Good parameters: P-256 bits (jwk, object(kty, crv, x, y), {name: ECDSA, namedCurve: P-256}, true, [verify, verify]) PASS Good parameters: P-256 bits (raw, buffer(65), {name: ECDSA, namedCurve: P-256}, true, [verify, verify]) NOTRUN Good parameters: P-256 bits (raw, buffer(33, compressed), {name: ECDSA, namedCurve: P-256}, true, [verify, verify]) Compressed point format not supported: DataError: Data provided to an operation does not meet requirements @@ -42,17 +42,17 @@ PASS Good parameters: P-256 bits (jwk, object(kty, crv, x, y, d), {name: ECDSA, namedCurve: P-256}, false, [sign, sign]) PASS Empty Usages: P-256 bits (jwk, object(kty, crv, x, y, d), {name: ECDSA, namedCurve: P-256}, false, []) PASS Good parameters: P-384 bits (spki, buffer(120), {name: ECDSA, namedCurve: P-384}, true, [verify]) -PASS Good parameters: P-384 bits (spki, buffer(72, compressed), {name: ECDSA, namedCurve: P-384}, true, [verify]) +FAIL Good parameters: P-384 bits (spki, buffer(72, compressed), {name: ECDSA, namedCurve: P-384}, true, [verify]) assert_true: Round trip works expected true got false PASS Good parameters: P-384 bits (jwk, object(kty, crv, x, y), {name: ECDSA, namedCurve: P-384}, true, [verify]) PASS Good parameters: P-384 bits (raw, buffer(97), {name: ECDSA, namedCurve: P-384}, true, [verify]) NOTRUN Good parameters: P-384 bits (raw, buffer(49, compressed), {name: ECDSA, namedCurve: P-384}, true, [verify]) Compressed point format not supported: DataError: Data provided to an operation does not meet requirements PASS Good parameters: P-384 bits (spki, buffer(120), {name: ECDSA, namedCurve: P-384}, true, []) -PASS Good parameters: P-384 bits (spki, buffer(72, compressed), {name: ECDSA, namedCurve: P-384}, true, []) +FAIL Good parameters: P-384 bits (spki, buffer(72, compressed), {name: ECDSA, namedCurve: P-384}, true, []) assert_true: Round trip works expected true got false PASS Good parameters: P-384 bits (jwk, object(kty, crv, x, y), {name: ECDSA, namedCurve: P-384}, true, []) PASS Good parameters: P-384 bits (raw, buffer(97), {name: ECDSA, namedCurve: P-384}, true, []) NOTRUN Good parameters: P-384 bits (raw, buffer(49, compressed), {name: ECDSA, namedCurve: P-384}, true, []) Compressed point format not supported: DataError: Data provided to an operation does not meet requirements PASS Good parameters: P-384 bits (spki, buffer(120), {name: ECDSA, namedCurve: P-384}, true, [verify, verify]) -PASS Good parameters: P-384 bits (spki, buffer(72, compressed), {name: ECDSA, namedCurve: P-384}, true, [verify, verify]) +FAIL Good parameters: P-384 bits (spki, buffer(72, compressed), {name: ECDSA, namedCurve: P-384}, true, [verify, verify]) assert_true: Round trip works expected true got false PASS Good parameters: P-384 bits (jwk, object(kty, crv, x, y), {name: ECDSA, namedCurve: P-384}, true, [verify, verify]) PASS Good parameters: P-384 bits (raw, buffer(97), {name: ECDSA, namedCurve: P-384}, true, [verify, verify]) NOTRUN Good parameters: P-384 bits (raw, buffer(49, compressed), {name: ECDSA, namedCurve: P-384}, true, [verify, verify]) Compressed point format not supported: DataError: Data provided to an operation does not meet requirements @@ -84,17 +84,17 @@ PASS Good parameters: P-384 bits (jwk, object(kty, crv, x, y, d), {name: ECDSA, namedCurve: P-384}, false, [sign, sign]) PASS Empty Usages: P-384 bits (jwk, object(kty, crv, x, y, d), {name: ECDSA, namedCurve: P-384}, false, []) PASS Good parameters: P-521 bits (spki, buffer(158), {name: ECDSA, namedCurve: P-521}, true, [verify]) -PASS Good parameters: P-521 bits (spki, buffer(90, compressed), {name: ECDSA, namedCurve: P-521}, true, [verify]) +FAIL Good parameters: P-521 bits (spki, buffer(90, compressed), {name: ECDSA, namedCurve: P-521}, true, [verify]) assert_true: Round trip works expected true got false PASS Good parameters: P-521 bits (jwk, object(kty, crv, x, y), {name: ECDSA, namedCurve: P-521}, true, [verify]) PASS Good parameters: P-521 bits (raw, buffer(133), {name: ECDSA, namedCurve: P-521}, true, [verify]) NOTRUN Good parameters: P-521 bits (raw, buffer(67, compressed), {name: ECDSA, namedCurve: P-521}, true, [verify]) Compressed point format not supported: DataError: Data provided to an operation does not meet requirements PASS Good parameters: P-521 bits (spki, buffer(158), {name: ECDSA, namedCurve: P-521}, true, []) -PASS Good parameters: P-521 bits (spki, buffer(90, compressed), {name: ECDSA, namedCurve: P-521}, true, []) +FAIL Good parameters: P-521 bits (spki, buffer(90, compressed), {name: ECDSA, namedCurve: P-521}, true, []) assert_true: Round trip works expected true got false PASS Good parameters: P-521 bits (jwk, object(kty, crv, x, y), {name: ECDSA, namedCurve: P-521}, true, []) PASS Good parameters: P-521 bits (raw, buffer(133), {name: ECDSA, namedCurve: P-521}, true, []) NOTRUN Good parameters: P-521 bits (raw, buffer(67, compressed), {name: ECDSA, namedCurve: P-521}, true, []) Compressed point format not supported: DataError: Data provided to an operation does not meet requirements PASS Good parameters: P-521 bits (spki, buffer(158), {name: ECDSA, namedCurve: P-521}, true, [verify, verify]) -PASS Good parameters: P-521 bits (spki, buffer(90, compressed), {name: ECDSA, namedCurve: P-521}, true, [verify, verify]) +FAIL Good parameters: P-521 bits (spki, buffer(90, compressed), {name: ECDSA, namedCurve: P-521}, true, [verify, verify]) assert_true: Round trip works expected true got false PASS Good parameters: P-521 bits (jwk, object(kty, crv, x, y), {name: ECDSA, namedCurve: P-521}, true, [verify, verify]) PASS Good parameters: P-521 bits (raw, buffer(133), {name: ECDSA, namedCurve: P-521}, true, [verify, verify]) NOTRUN Good parameters: P-521 bits (raw, buffer(67, compressed), {name: ECDSA, namedCurve: P-521}, true, [verify, verify]) Compressed point format not supported: DataError: Data provided to an operation does not meet requirements @@ -126,7 +126,7 @@ PASS Good parameters: P-521 bits (jwk, object(kty, crv, x, y, d), {name: ECDSA, namedCurve: P-521}, false, [sign, sign]) PASS Empty Usages: P-521 bits (jwk, object(kty, crv, x, y, d), {name: ECDSA, namedCurve: P-521}, false, []) PASS Good parameters: P-256 bits (spki, buffer(91), {name: ECDH, namedCurve: P-256}, true, []) -PASS Good parameters: P-256 bits (spki, buffer(59, compressed), {name: ECDH, namedCurve: P-256}, true, []) +FAIL Good parameters: P-256 bits (spki, buffer(59, compressed), {name: ECDH, namedCurve: P-256}, true, []) assert_true: Round trip works expected true got false PASS Good parameters: P-256 bits (jwk, object(kty, crv, x, y), {name: ECDH, namedCurve: P-256}, true, []) PASS Good parameters: P-256 bits (raw, buffer(65), {name: ECDH, namedCurve: P-256}, true, []) NOTRUN Good parameters: P-256 bits (raw, buffer(33, compressed), {name: ECDH, namedCurve: P-256}, true, []) Compressed point format not supported: DataError: Data provided to an operation does not meet requirements @@ -156,7 +156,7 @@ PASS Good parameters: P-256 bits (jwk, object(kty, crv, x, y, d), {name: ECDH, namedCurve: P-256}, false, [deriveKey, deriveBits, deriveKey, deriveBits]) PASS Empty Usages: P-256 bits (jwk, object(kty, crv, x, y, d), {name: ECDH, namedCurve: P-256}, false, []) PASS Good parameters: P-384 bits (spki, buffer(120), {name: ECDH, namedCurve: P-384}, true, []) -PASS Good parameters: P-384 bits (spki, buffer(72, compressed), {name: ECDH, namedCurve: P-384}, true, []) +FAIL Good parameters: P-384 bits (spki, buffer(72, compressed), {name: ECDH, namedCurve: P-384}, true, []) assert_true: Round trip works expected true got false PASS Good parameters: P-384 bits (jwk, object(kty, crv, x, y), {name: ECDH, namedCurve: P-384}, true, []) PASS Good parameters: P-384 bits (raw, buffer(97), {name: ECDH, namedCurve: P-384}, true, []) NOTRUN Good parameters: P-384 bits (raw, buffer(49, compressed), {name: ECDH, namedCurve: P-384}, true, []) Compressed point format not supported: DataError: Data provided to an operation does not meet requirements @@ -186,7 +186,7 @@ PASS Good parameters: P-384 bits (jwk, object(kty, crv, x, y, d), {name: ECDH, namedCurve: P-384}, false, [deriveKey, deriveBits, deriveKey, deriveBits]) PASS Empty Usages: P-384 bits (jwk, object(kty, crv, x, y, d), {name: ECDH, namedCurve: P-384}, false, []) PASS Good parameters: P-521 bits (spki, buffer(158), {name: ECDH, namedCurve: P-521}, true, []) -PASS Good parameters: P-521 bits (spki, buffer(90, compressed), {name: ECDH, namedCurve: P-521}, true, []) +FAIL Good parameters: P-521 bits (spki, buffer(90, compressed), {name: ECDH, namedCurve: P-521}, true, []) assert_true: Round trip works expected true got false PASS Good parameters: P-521 bits (jwk, object(kty, crv, x, y), {name: ECDH, namedCurve: P-521}, true, []) PASS Good parameters: P-521 bits (raw, buffer(133), {name: ECDH, namedCurve: P-521}, true, []) NOTRUN Good parameters: P-521 bits (raw, buffer(67, compressed), {name: ECDH, namedCurve: P-521}, true, []) Compressed point format not supported: DataError: Data provided to an operation does not meet requirements DIFF URLs: https://build.webkit.org/results/Apple-Ventura-Debug-WK1-Tests/281139@main%20(6193)/imported/w3c/web-platform-tests/WebCryptoAPI/import_export/ec_importKey.https.any-pretty-diff.html https://build.webkit.org/results/Apple-Ventura-Debug-WK1-Tests/281139@main%20(6193)/imported/w3c/web-platform-tests/WebCryptoAPI/import_export/ec_importKey.https.any.worker-pretty-diff.html REGRESSION: Contextual information indicates this most likely regressed with the enablement of CryptoKit in 281139@main. NOTE: It looks like there's already an expectation set for Ventura, so I'll just set the expectation for iOS 18. 2049856 1 ben_schwartz 2024-07-31 10:36:43 -0700 <rdar://problem/132913336> 2049861 2 ews-feeder 2024-07-31 10:50:28 -0700 Test gardening commit 281660@main (a2769c42728c): <https://commits.webkit.org/281660@main> Reviewed commits have been landed. Closing PR #31548 and removing active labels. 2049867 3 ews-feeder 2024-07-31 11:01:29 -0700 Test gardening commit 281661@main (3f5458f4010b): <https://commits.webkit.org/281661@main> Reviewed commits have been landed. Closing PR #31551 and removing active labels. 2049898 4 nitinmahendru 2024-07-31 12:43:54 -0700 Pull request: https://github.com/WebKit/WebKit/pull/31555 2050669 5 ews-feeder 2024-08-05 09:39:13 -0700 Committed 281832@main (0bcf166a295a): <https://commits.webkit.org/281832@main> Reviewed commits have been landed. Closing PR #31555 and removing active labels.