Bug 274219 – REGRESSION (278786@main): [ MacOS iOS ] 3x http/wpt/webauthn tests are consistent failures

• Component: New Bugs
• Status: RESOLVED CONFIGURATION CHANGED

[Jay Stfleur]

Created attachment 471415 [details]
Text diffs

Description:
http/wpt/webauthn/idl.https.html
http/wpt/webauthn/public-key-credential-cross-origin.https.html 
http/wpt/webauthn/public-key-credential-same-origin-with-ancestors.https.html  

All 3 tests are consistently failing on Ventura+ and iOS after changes on 278786@main

Buildbot URL:
https://build.webkit.org/#/builders/926/builds/2841

History:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&test=http%2Fwpt%2Fwebauthn%2Fidl.https.html&test=http%2Fwpt%2Fwebauthn%2Fpublic-key-credential-cross-origin.https.html&test=http%2Fwpt%2Fwebauthn%2Fpublic-key-credential-same-origin-with-ancestors.https.html

Diff/Image Diff/Crash Log:
--- /Volumes/Data/worker/Apple-Sonoma-Release-WK2-Tests/build/layout-test-results/http/wpt/webauthn/public-key-credential-same-origin-with-ancestors.https-expected.txt
+++ /Volumes/Data/worker/Apple-Sonoma-Release-WK2-Tests/build/layout-test-results/http/wpt/webauthn/public-key-credential-same-origin-with-ancestors.https-actual.txt
@@ -3,6 +3,6 @@
 PASS Tests that a frame that doesn't share the same origin with all its ancestors could not access the API.
 PASS Tests that a frame that doesn't share the same origin with all its ancestors could not access the API. 2
 PASS Tests that a frame that is same-site, cross-origin without publickey-credentials-get feature policy cannot use get().
-PASS Tests that a frame that is same-site, cross-origin with publickey-credentials-get feature policy can use get().
-PASS Tests that a frame using an ip address that is cross-origin, NOT same-site with publickey-credentials-get feature policy cannot use get().
+FAIL Tests that a frame that is same-site, cross-origin with publickey-credentials-get feature policy can use get(). assert_equals: expected "PASS!" but got "Throw NotAllowedError: The origin of the document is not the same as its ancestors."
+FAIL Tests that a frame using an ip address that is cross-origin, NOT same-site with publickey-credentials-get feature policy cannot use get(). assert_equals: expected "Throw SecurityError: The effective domain of the document is not a valid domain." but got "Throw NotAllowedError: The origin of the document is not the same as its ancestors."
 

REPRODUCIBILITY:
run-webkit-tests http/wpt/webauthn/public-key-credential-cross-origin.https.html --iterations 5

[Radar WebKit Bug Importer]

<rdar://problem/128137880>

[EWS]

Test gardening commit 278820@main (e2c6bb582087): <https://commits.webkit.org/278820@main>

Reviewed commits have been landed. Closing PR #28604 and removing active labels.

[Ryan Haddad]

It appears that these tests are marked as [ Crash ] (via https://commits.webkit.org/274998@main), so EWS did not run them and was not able to flag these failures pre-commit.

[Alexey Proskuryakov]

This is getting addressed via bug 274227 and bug 274228.