Bug 271207 - REGRESSION (275711@main): 5 http/wpt/webauthn/public-key-credential* layout tests are constantly crashing/failing.
Summary: REGRESSION (275711@main): 5 http/wpt/webauthn/public-key-credential* layout t...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2024-03-18 19:13 PDT by Ben Schwartz
Modified: 2024-03-18 20:31 PDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ben Schwartz 2024-03-18 19:13:04 PDT
The following WebKit layout tests are constantly crashing on debug, failing on other configurations:

http/wpt/webauthn/public-key-credential-create-failure-local.https.html
http/wpt/webauthn/public-key-credential-create-success-local.https.html
http/wpt/webauthn/public-key-credential-get-failure-local.https.html
http/wpt/webauthn/public-key-credential-get-success-local.https.html (not tested on bots, but the reported results are encountered locally when forcing to run)

HISTORY:

https://results.webkit.org/?platform=ios&platform=mac&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=http%2Fwpt%2Fwebauthn%2Fpublic-key-credential-create-failure-local.https.html&test=http%2Fwpt%2Fwebauthn%2Fpublic-key-credential-create-success-local.https.html&test=http%2Fwpt%2Fwebauthn%2Fpublic-key-credential-get-failure-local.https.html&test=http%2Fwpt%2Fwebauthn%2Fpublic-key-credential-get-success-local.https.html

REPRODUCIBILITY:

I was able to reproduce this issue on iOS Simulator (iOS 17.4, Xcode 15.3/15E204a) ToT using the following command:

run-webkit-tests --ios-simulator --clobber-old-results -v http/wpt/webauthn/public-key-credential-create-failure-local.https.html http/wpt/webauthn/public-key-credential-create-success-local.https.html http/wpt/webauthn/public-key-credential-get-failure-local.https.html http/wpt/webauthn/public-key-credential-get-success-local.https.html

REGRESSION:

These four tests appear to have regressed at 275711@main.
Comment 1 Ben Schwartz 2024-03-18 19:13:35 PDT
<rdar://problem/124982361>
Comment 2 Ben Schwartz 2024-03-18 20:20:40 PDT
This test is also experiencing the same symptoms with the same regression point:

http/wpt/webauthn/public-key-credential-create-failure-local-silent.https.html
Comment 3 EWS 2024-03-18 20:31:30 PDT
Test gardening commit 276327@main (3a37af3a18de): <https://commits.webkit.org/276327@main>

Reviewed commits have been landed. Closing PR #26098 and removing active labels.