Bug 260113 - [ macOS WK2 arm64 ] http/wpt/webauthn/ctap-hid-failure.https.html is a flaky failure
Summary: [ macOS WK2 arm64 ] http/wpt/webauthn/ctap-hid-failure.https.html is a flaky ...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-08-11 19:33 PDT by Ben Schwartz
Modified: 2023-08-11 19:59 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ben Schwartz 2023-08-11 19:33:47 PDT
http/wpt/webauthn/ctap-hid-failure.https.html

This test is a flaky failure on arm64 macOS machines with wk2.

TEXT DIFF:

 PASS CTAP HID with msg sub stage data not sent error in a mock hid authenticator.
 PASS CTAP HID with msg sub stage empty report error in a mock hid authenticator.
 PASS CTAP HID with msg sub stage wrong channel id error in a mock hid authenticator.
-PASS CTAP HID with request::msg stage wrong channel id error in a mock hid authenticator.
+FAIL CTAP HID with request::msg stage wrong channel id error in a mock hid authenticator. assert_throws_dom: Unknown internal error. Error code: 18 function "function() { throw e }" threw object "NotAllowedError: Operation timed out." that is not a DOMException UnknownError: property "name" is equal to "NotAllowedError", expected "UnknownError"

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Debug-AppleSilicon-WK2-Tests/265307@main%20(2838)/http/wpt/webauthn/ctap-hid-failure.https-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura ToT running the test as follows:

run-webkit-tests --iterations 1000 --clobber-old-results --child-processes=10 -f --verbose http/wpt/webauthn/ctap-hid-failure.https.html --force
Comment 1 Radar WebKit Bug Importer 2023-08-11 19:34:04 PDT
<rdar://problem/113783464>
Comment 2 EWS 2023-08-11 19:53:23 PDT
Test gardening commit 266844@main (e330442458cc): <https://commits.webkit.org/266844@main>

Reviewed commits have been landed. Closing PR #16638 and removing active labels.
Comment 3 Ben Schwartz 2023-08-11 19:59:27 PDT
I have marked this test as a flaky failure while this issue is being investigated. (PR link: https://github.com/WebKit/WebKit/pull/16638)