Bug 196377

Summary: [ Mac WK2 ] Layout Test http/wpt/webauthn/public-key-credential-get-success-hid.https.html is a flaky failure
Product: WebKit Reporter: Shawn Roberts <sroberts>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: RESOLVED DUPLICATE    
Severity: Normal CC: alex.gaynor, bfulgham, cdumez, jiewen_tan, lforschler, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=194780
https://bugs.webkit.org/show_bug.cgi?id=192061
https://bugs.webkit.org/show_bug.cgi?id=188623
https://bugs.webkit.org/show_bug.cgi?id=197917

Description Shawn Roberts 2019-03-28 15:48:11 PDT
The following layout test is failing on Mac WK2

http/wpt/webauthn/public-key-credential-get-success-hid.https.html

Probable cause:

Unsure of regression point. Has been a flaky failure as far back as the history of the dashboard goes. Searching through trac history this test and http/wpt/webauthn/public-key-credential-create-success-hid.https.html have a history of being flaky failures and several fixes have come out and test remains flaky. 

Both tests were added in https://trac.webkit.org/changeset/238166/webkit 

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Fwpt%2Fwebauthn%2Fpublic-key-credential-get-success-hid.https.html

Diff:

--- /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/http/wpt/webauthn/public-key-credential-get-success-hid.https-expected.txt
+++ /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/http/wpt/webauthn/public-key-credential-get-success-hid.https-actual.txt
@@ -2,6 +2,6 @@
 PASS PublicKeyCredential's [[get]] with minimum options in a mock hid authenticator. 
 PASS PublicKeyCredential's [[get]] with matched allow credentials in a mock hid authenticator. 
 PASS PublicKeyCredential's [[get]] with userVerification { preferred } in a mock hid authenticator. 
-PASS PublicKeyCredential's [[get]] with userVerification { discouraged } in a mock hid authenticator. 
+FAIL PublicKeyCredential's [[get]] with userVerification { discouraged } in a mock hid authenticator. promise_test: Unhandled rejection with value: object "NotAllowedError: Operation timed out."
 PASS PublicKeyCredential's [[get]] with mixed options in a mock hid authenticator.
Comment 1 Radar WebKit Bug Importer 2019-03-28 16:00:38 PDT
<rdar://problem/49400175>
Comment 2 Shawn Roberts 2019-03-28 16:12:29 PDT
Marked flaky in https://trac.webkit.org/changeset/243629/webkit while waiting for a fix.
Comment 3 Brent Fulgham 2019-05-29 13:28:14 PDT

*** This bug has been marked as a duplicate of bug 197917 ***