Bug 260113

Summary: [ macOS WK2 arm64 ] http/wpt/webauthn/ctap-hid-failure.https.html is a flaky failure
Product: WebKit Reporter: Ben Schwartz <ben_schwartz>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: pascoe, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Ben Schwartz 2023-08-11 19:33:47 PDT
http/wpt/webauthn/ctap-hid-failure.https.html

This test is a flaky failure on arm64 macOS machines with wk2.

TEXT DIFF:

 PASS CTAP HID with msg sub stage data not sent error in a mock hid authenticator.
 PASS CTAP HID with msg sub stage empty report error in a mock hid authenticator.
 PASS CTAP HID with msg sub stage wrong channel id error in a mock hid authenticator.
-PASS CTAP HID with request::msg stage wrong channel id error in a mock hid authenticator.
+FAIL CTAP HID with request::msg stage wrong channel id error in a mock hid authenticator. assert_throws_dom: Unknown internal error. Error code: 18 function "function() { throw e }" threw object "NotAllowedError: Operation timed out." that is not a DOMException UnknownError: property "name" is equal to "NotAllowedError", expected "UnknownError"

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Debug-AppleSilicon-WK2-Tests/265307@main%20(2838)/http/wpt/webauthn/ctap-hid-failure.https-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura ToT running the test as follows:

run-webkit-tests --iterations 1000 --clobber-old-results --child-processes=10 -f --verbose http/wpt/webauthn/ctap-hid-failure.https.html --force
Comment 1 Radar WebKit Bug Importer 2023-08-11 19:34:04 PDT
<rdar://problem/113783464>
Comment 2 EWS 2023-08-11 19:53:23 PDT
Test gardening commit 266844@main (e330442458cc): <https://commits.webkit.org/266844@main>

Reviewed commits have been landed. Closing PR #16638 and removing active labels.
Comment 3 Ben Schwartz 2023-08-11 19:59:27 PDT
I have marked this test as a flaky failure while this issue is being investigated. (PR link: https://github.com/WebKit/WebKit/pull/16638)