Bug 232042 – [ macOS wk1 ] imported/w3c/web-platform-tests/html/semantics/interactive-elements/the-dialog-element/dialog-autofocus.html is a flaky failure

• Status: REOPENED
• Component: New Bugs

imported/w3c/web-platform-tests/html/semantics/interactive-elements/the-dialog-element/dialog-autofocus.html

Is a flaky failure on macOS wk1.

History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Finteractive-elements%2Fthe-dialog-element%2Fdialog-autofocus.html

Result page: https://build.webkit.org/results/Apple-BigSur-Debug-WK1-Tests/r284539%20(4862)/results.html#

Diff:

--- /Volumes/Data/worker/bigsur-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/interactive-elements/the-dialog-element/dialog-autofocus-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/interactive-elements/the-dialog-element/dialog-autofocus-actual.txt
@@ -1,4 +1,6 @@
 
 
-PASS autofocus when a modal dialog is opened
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT autofocus when a modal dialog is opened Test timed out
+

[Radar WebKit Bug Importer]

<rdar://problem/84478439>

Marked test expectations https://trac.webkit.org/changeset/284567/webkit

I was able to reproduce the failure at TOT locally.

I was expecting to have the same regression point as Bug 231918, but test failed at r283934 with a different diff:

@@ -1,4 +1,6 @@
 
 
-PASS autofocus when a modal dialog is opened
 
+
+FAIL autofocus when a modal dialog is opened assert_equals: expected Element node <button id="autofocus-button" autofocus=""></button> but got Element node <button id="outer-button" autofocus=""></button>
+

When I look at the diff on r283936, the test failed with the same diff that I reproduced with r283934 (https://build.webkit.org/results/Apple-Catalina-Release-WK1-Tests/r283936%20(6251)/results.html)

I will research more.

The test failed with r284116 and newer revisions with:

====================

-PASS autofocus when a modal dialog is opened
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT autofocus when a modal dialog is opened Test timed out
+

====================

It failed with r284115 and older revisions (as old as r280001. Didn't try older than r280001) with a different diff:

====================

-PASS autofocus when a modal dialog is opened
 
+
+FAIL autofocus when a modal dialog is opened assert_equals: expected Element node <button id="autofocus-button" autofocus=""></button> but got Element node <button id="outer-button" autofocus=""></button>
+

====================

According to the history, it first started failing at r283936.

[Chris Dumez]

*** This bug has been marked as a duplicate of bug 231918 ***

[Tim Nguyen (:ntim)]

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Finteractive-elements%2Fthe-dialog-element%2Fdialog-autofocus.html


The results DB suggests this isn't fixed.