198810 2019-06-12 15:07:27 -0700 Layout Test http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https.html is flaky 2019-09-09 12:16:24 -0700 1 1 1 Unclassified WebKit Tools / Tests WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 repstein jiewen_tan commit-queue dewei_zhu jiewen_tan webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1544252 0 repstein 2019-06-12 15:07:27 -0700 The following layout test is flaky on Mac Debug WK2 http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https.html Probable cause: I believe this test has been failing since it was introduced. I reproduced this by: run-webkit-tests --iter 1000 http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https.html -f Using spade 245262, where the test was introduced. Flakiness Dashboard: https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Fwpt%2Fwebauthn%2Fpublic-key-credential-create-failure-u2f-silent.https.html Diff: --- /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https-expected.txt +++ /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https-actual.txt @@ -3,7 +3,7 @@ PASS PublicKeyCredential's [[create]] with malformed U2F register response in a mock hid authenticator. PASS PublicKeyCredential's [[create]] with register command error in a mock hid authenticator. PASS PublicKeyCredential's [[create]] with bogus command error in a mock hid authenticator. -PASS PublicKeyCredential's [[create]] with first exclude credential matched in a mock hid authenticator. +FAIL PublicKeyCredential's [[create]] with first exclude credential matched in a mock hid authenticator. assert_throws: At least one credential matches an entry of the excludeCredentials list in the authenticator. function "function () { throw e }" threw object "NotAllowedError: Operation timed out." that is not a DOMException InvalidStateError: property "code" is equal to 0, expected 11 PASS PublicKeyCredential's [[create]] with second exclude credential matched in a mock hid authenticator. PASS PublicKeyCredential's [[create]] with first exclude credential matched in a mock hid authenticator. Test of user presence. 1544254 1 webkit-bug-importer 2019-06-12 15:09:38 -0700 <rdar://problem/51684767> 1568821 2 378270 jiewen_tan 2019-09-06 20:40:14 -0700 Created attachment 378270 Patch 1568949 3 dewei_zhu 2019-09-07 18:21:17 -0700 rs=me 1569186 4 378270 jiewen_tan 2019-09-09 10:44:10 -0700 Comment on attachment 378270 Patch Thanks, Dewei. 1569235 5 378270 commit-queue 2019-09-09 12:16:22 -0700 Comment on attachment 378270 Patch Clearing flags on attachment: 378270 Committed r249656: <https://trac.webkit.org/changeset/249656> 1569236 6 commit-queue 2019-09-09 12:16:24 -0700 All reviewed patches have been landed. Closing bug. 378270 2019-09-06 20:40:14 -0700 2019-09-09 12:16:22 -0700 Patch bug-198810-20190906204013.patch text/plain 2047 jiewen_tan U3VidmVyc2lvbiBSZXZpc2lvbjogMjQ5NjA1CmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggMjg0NTBmZjU3MzVmNmQ5ZmRlYWI1 ZWQ1OTY0YTk4YzU2NjdlZjkwZS4uNzY3N2NjZmEwNWJlZDI1MDE0NTU5YzE2NDFmOTc5NjUzM2Rl Nzg2OSAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDEzIEBACisyMDE5LTA5LTA2ICBKaWV3ZW4gVGFuICA8amll d2VuX3RhbkBhcHBsZS5jb20+CisKKyAgICAgICAgTGF5b3V0IFRlc3QgaHR0cC93cHQvd2ViYXV0 aG4vcHVibGljLWtleS1jcmVkZW50aWFsLWNyZWF0ZS1mYWlsdXJlLXUyZi1zaWxlbnQuaHR0cHMu aHRtbCBpcyBmbGFreQorICAgICAgICBodHRwczovL2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5j Z2k/aWQ9MTk4ODEwCisKKyAgICAgICAgUmV2aWV3ZWQgYnkgTk9CT0RZIChPT1BTISkuCisKKyAg ICAgICAgKiBodHRwL3dwdC93ZWJhdXRobi9wdWJsaWMta2V5LWNyZWRlbnRpYWwtY3JlYXRlLWZh aWx1cmUtdTJmLXNpbGVudC5odHRwcy5odG1sOgorICAgICAgICBSZW1vdmVkIHRoZSB0aW1lb3V0 IHZhbHVlIGdpdmVuIHRoZXNlIHRlc3RzIHNob3VsZCByZXBvcnQgdGhlIGV4Y2VwdGlvbiBpbW1l ZGlhdGVseS4KKwogMjAxOS0wOS0wNiAgV2Vuc29uIEhzaWVoICA8d2Vuc29uX2hzaWVoQGFwcGxl LmNvbT4KIAogICAgICAgICBJbmNvcnJlY3Qgc2VsZWN0aW9uIHJlY3QgcmV2ZWFsZWQgYWZ0ZXIg cGFzdGluZyBpbWFnZXMgaW4gYSBjb250ZW50ZWRpdGFibGUgZWxlbWVudApkaWZmIC0tZ2l0IGEv TGF5b3V0VGVzdHMvaHR0cC93cHQvd2ViYXV0aG4vcHVibGljLWtleS1jcmVkZW50aWFsLWNyZWF0 ZS1mYWlsdXJlLXUyZi1zaWxlbnQuaHR0cHMuaHRtbCBiL0xheW91dFRlc3RzL2h0dHAvd3B0L3dl YmF1dGhuL3B1YmxpYy1rZXktY3JlZGVudGlhbC1jcmVhdGUtZmFpbHVyZS11MmYtc2lsZW50Lmh0 dHBzLmh0bWwKaW5kZXggNjQxYzBlZjdjYTA2MzYzMWUxZjhkYmIxZTBjZTUyYTgxZjg1OTVjNy4u YWVkOTdjMjU2NjE2MjlkYjlhYzcwMzhlMTcxN2M0NDg0OGVmNmFkNCAxMDA2NDQKLS0tIGEvTGF5 b3V0VGVzdHMvaHR0cC93cHQvd2ViYXV0aG4vcHVibGljLWtleS1jcmVkZW50aWFsLWNyZWF0ZS1m YWlsdXJlLXUyZi1zaWxlbnQuaHR0cHMuaHRtbAorKysgYi9MYXlvdXRUZXN0cy9odHRwL3dwdC93 ZWJhdXRobi9wdWJsaWMta2V5LWNyZWRlbnRpYWwtY3JlYXRlLWZhaWx1cmUtdTJmLXNpbGVudC5o dHRwcy5odG1sCkBAIC0xMDcsNyArMTA3LDYgQEAKICAgICAgICAgICAgICAgICBjaGFsbGVuZ2U6 IGFzY2lpVG9VaW50OEFycmF5KCIxMjM0NTYiKSwKICAgICAgICAgICAgICAgICBwdWJLZXlDcmVk UGFyYW1zOiBbeyB0eXBlOiAicHVibGljLWtleSIsIGFsZzogLTcgfV0sCiAgICAgICAgICAgICAg ICAgZXhjbHVkZUNyZWRlbnRpYWxzOiBbeyB0eXBlOiAicHVibGljLWtleSIsIGlkOiBCYXNlNjRV UkwucGFyc2UodGVzdENyZWRlbnRpYWxJZEJhc2U2NCkgfV0sCi0gICAgICAgICAgICAgICAgdGlt ZW91dDogMTAKICAgICAgICAgICAgIH0KICAgICAgICAgfTsKIApAQCAtMTMxLDcgKzEzMCw2IEBA CiAgICAgICAgICAgICAgICAgY2hhbGxlbmdlOiBhc2NpaVRvVWludDhBcnJheSgiMTIzNDU2Iiks CiAgICAgICAgICAgICAgICAgcHViS2V5Q3JlZFBhcmFtczogW3sgdHlwZTogInB1YmxpYy1rZXki LCBhbGc6IC03IH1dLAogICAgICAgICAgICAgICAgIGV4Y2x1ZGVDcmVkZW50aWFsczogW3sgdHlw ZTogInB1YmxpYy1rZXkiLCBpZDogQmFzZTY0VVJMLnBhcnNlKHRlc3RDcmVkZW50aWFsSWRCYXNl NjQpIH0sIHsgdHlwZTogInB1YmxpYy1rZXkiLCBpZDogQmFzZTY0VVJMLnBhcnNlKHRlc3RDcmVk ZW50aWFsSWRCYXNlNjQpIH1dLCAvLyBUaGUgY29udGVudCBkb2Vzbid0IG1hdHRlci4KLSAgICAg ICAgICAgICAgICB0aW1lb3V0OiAxMAogICAgICAgICAgICAgfQogICAgICAgICB9OwogCg==