232042 2021-10-20 14:08:33 -0700 [ macOS wk1 ] imported/w3c/web-platform-tests/html/semantics/interactive-elements/the-dialog-element/dialog-autofocus.html is a flaky failure 2021-12-17 07:07:58 -0800 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Mac (Intel) Unspecified REOPENED InRadar P2 Normal --- 1 ayumi_kojima webkit-unassigned cdumez ntim webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1806821 0 ayumi_kojima 2021-10-20 14:08:33 -0700 imported/w3c/web-platform-tests/html/semantics/interactive-elements/the-dialog-element/dialog-autofocus.html Is a flaky failure on macOS wk1. History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Finteractive-elements%2Fthe-dialog-element%2Fdialog-autofocus.html Result page: https://build.webkit.org/results/Apple-BigSur-Debug-WK1-Tests/r284539%20(4862)/results.html# Diff: --- /Volumes/Data/worker/bigsur-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/interactive-elements/the-dialog-element/dialog-autofocus-expected.txt +++ /Volumes/Data/worker/bigsur-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/interactive-elements/the-dialog-element/dialog-autofocus-actual.txt @@ -1,4 +1,6 @@ -PASS autofocus when a modal dialog is opened +Harness Error (TIMEOUT), message = null +TIMEOUT autofocus when a modal dialog is opened Test timed out + 1806824 1 webkit-bug-importer 2021-10-20 14:13:02 -0700 <rdar://problem/84478439> 1806825 2 ayumi_kojima 2021-10-20 14:13:57 -0700 Marked test expectations https://trac.webkit.org/changeset/284567/webkit 1806942 3 ayumi_kojima 2021-10-20 17:15:49 -0700 I was able to reproduce the failure at TOT locally. I was expecting to have the same regression point as Bug 231918, but test failed at r283934 with a different diff: @@ -1,4 +1,6 @@ -PASS autofocus when a modal dialog is opened + +FAIL autofocus when a modal dialog is opened assert_equals: expected Element node <button id="autofocus-button" autofocus=""></button> but got Element node <button id="outer-button" autofocus=""></button> + When I look at the diff on r283936, the test failed with the same diff that I reproduced with r283934 (https://build.webkit.org/results/Apple-Catalina-Release-WK1-Tests/r283936%20(6251)/results.html) I will research more. 1809895 4 ayumi_kojima 2021-10-28 16:31:06 -0700 The test failed with r284116 and newer revisions with: ==================== -PASS autofocus when a modal dialog is opened +Harness Error (TIMEOUT), message = null +TIMEOUT autofocus when a modal dialog is opened Test timed out + ==================== It failed with r284115 and older revisions (as old as r280001. Didn't try older than r280001) with a different diff: ==================== -PASS autofocus when a modal dialog is opened + +FAIL autofocus when a modal dialog is opened assert_equals: expected Element node <button id="autofocus-button" autofocus=""></button> but got Element node <button id="outer-button" autofocus=""></button> + ==================== According to the history, it first started failing at r283936. 1812853 5 cdumez 2021-11-08 14:55:52 -0800 *** This bug has been marked as a duplicate of bug 231918 *** 1825073 6 ntim 2021-12-17 07:07:19 -0800 https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Finteractive-elements%2Fthe-dialog-element%2Fdialog-autofocus.html The results DB suggests this isn't fixed.