Bug 232042 - [ macOS wk1 ] imported/w3c/web-platform-tests/html/semantics/interactive-elements/the-dialog-element/dialog-autofocus.html is a flaky failure
Summary: [ macOS wk1 ] imported/w3c/web-platform-tests/html/semantics/interactive-elem...
Status: REOPENED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Mac (Intel) Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-10-20 14:08 PDT by ayumi_kojima
Modified: 2021-12-17 07:07 PST (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description ayumi_kojima 2021-10-20 14:08:33 PDT
imported/w3c/web-platform-tests/html/semantics/interactive-elements/the-dialog-element/dialog-autofocus.html

Is a flaky failure on macOS wk1.

History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Finteractive-elements%2Fthe-dialog-element%2Fdialog-autofocus.html

Result page: https://build.webkit.org/results/Apple-BigSur-Debug-WK1-Tests/r284539%20(4862)/results.html#

Diff:

--- /Volumes/Data/worker/bigsur-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/interactive-elements/the-dialog-element/dialog-autofocus-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/interactive-elements/the-dialog-element/dialog-autofocus-actual.txt
@@ -1,4 +1,6 @@
 
 
-PASS autofocus when a modal dialog is opened
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT autofocus when a modal dialog is opened Test timed out
+
Comment 1 Radar WebKit Bug Importer 2021-10-20 14:13:02 PDT
<rdar://problem/84478439>
Comment 2 ayumi_kojima 2021-10-20 14:13:57 PDT
Marked test expectations https://trac.webkit.org/changeset/284567/webkit
Comment 3 ayumi_kojima 2021-10-20 17:15:49 PDT
I was able to reproduce the failure at TOT locally.

I was expecting to have the same regression point as Bug 231918, but test failed at r283934 with a different diff:

@@ -1,4 +1,6 @@
 
 
-PASS autofocus when a modal dialog is opened
 
+
+FAIL autofocus when a modal dialog is opened assert_equals: expected Element node <button id="autofocus-button" autofocus=""></button> but got Element node <button id="outer-button" autofocus=""></button>
+

When I look at the diff on r283936, the test failed with the same diff that I reproduced with r283934 (https://build.webkit.org/results/Apple-Catalina-Release-WK1-Tests/r283936%20(6251)/results.html)

I will research more.
Comment 4 ayumi_kojima 2021-10-28 16:31:06 PDT
The test failed with r284116 and newer revisions with:

====================

-PASS autofocus when a modal dialog is opened
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT autofocus when a modal dialog is opened Test timed out
+

====================

It failed with r284115 and older revisions (as old as r280001. Didn't try older than r280001) with a different diff:

====================

-PASS autofocus when a modal dialog is opened
 
+
+FAIL autofocus when a modal dialog is opened assert_equals: expected Element node <button id="autofocus-button" autofocus=""></button> but got Element node <button id="outer-button" autofocus=""></button>
+

====================

According to the history, it first started failing at r283936.
Comment 5 Chris Dumez 2021-11-08 14:55:52 PST

*** This bug has been marked as a duplicate of bug 231918 ***