Bug 198810 – Layout Test http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https.html is flaky

• Status: RESOLVED
• Resolution: FIXED
• Component: Tools / Tests

[Russell Epstein]

The following layout test is flaky on Mac Debug WK2

http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https.html

Probable cause:

I believe this test has been failing since it was introduced.

I reproduced this by:

run-webkit-tests --iter 1000 http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https.html -f

Using spade 245262, where the test was introduced.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Fwpt%2Fwebauthn%2Fpublic-key-credential-create-failure-u2f-silent.https.html

Diff:

--- /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https-expected.txt
+++ /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https-actual.txt
@@ -3,7 +3,7 @@
 PASS PublicKeyCredential's [[create]] with malformed U2F register response in a mock hid authenticator. 
 PASS PublicKeyCredential's [[create]] with register command error in a mock hid authenticator. 
 PASS PublicKeyCredential's [[create]] with bogus command error in a mock hid authenticator. 
-PASS PublicKeyCredential's [[create]] with first exclude credential matched in a mock hid authenticator. 
+FAIL PublicKeyCredential's [[create]] with first exclude credential matched in a mock hid authenticator. assert_throws: At least one credential matches an entry of the excludeCredentials list in the authenticator. function "function () { throw e }" threw object "NotAllowedError: Operation timed out." that is not a DOMException InvalidStateError: property "code" is equal to 0, expected 11
 PASS PublicKeyCredential's [[create]] with second exclude credential matched in a mock hid authenticator. 
 PASS PublicKeyCredential's [[create]] with first exclude credential matched in a mock hid authenticator. Test of user presence.

[Radar WebKit Bug Importer]

<rdar://problem/51684767>

[Jiewen Tan]

Created attachment 378270 [details]
Patch

rs=me

[Jiewen Tan]

Comment on attachment 378270 [details]
Patch

Thanks, Dewei.

[WebKit Commit Bot]

Comment on attachment 378270 [details]
Patch

Clearing flags on attachment: 378270

Committed r249656: <https://trac.webkit.org/changeset/249656>

[WebKit Commit Bot]

All reviewed patches have been landed.  Closing bug.