Bug 207962 – [ Mac wk2 ] accessibility/mac/aria-menu-item-selected-notification.html is flaky timing out.

• Component: Accessibility
• Status: NEW

[Jason Lawrence]

accessibility/mac/aria-menu-item-selected-notification.html

Description:
This test is flaky timing out on Mac wk2. The oldest timeout that I see is r251108, the oldest that I can load with a matching diff is r255863.

History:
https://results.webkit.org/?suite=layout-tests&test=accessibility%2Fmac%2Faria-menu-item-selected-notification.html&flavor=wk2&style=release&limit=50000

Diff:
--- /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/accessibility/mac/aria-menu-item-selected-notification-expected.txt
+++ /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/accessibility/mac/aria-menu-item-selected-notification-actual.txt
@@ -1,25 +1,5 @@
-Menu item 1
-Menu item 2
-Menu item 3
-This tests that a AXMenuItemSelected notification gets fired when a menuitem is focused.
+#PID UNRESPONSIVE - WebKitTestRunner (pid 52130)
+FAIL: Timed out waiting for notifyDone to be called
 
-On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
-
-
-PASS addedNotification is true
-Received menu item selected notification: AXMenuItemSelected
-Menu item selected element: AXRole: AXMenuItem
-Menu item selected element description: AXDescription: item1
-
-Received menu item selected notification: AXMenuItemSelected
-Menu item selected element: AXRole: AXMenuItem
-Menu item selected element description: AXDescription: item2
-
-Received menu item selected notification: AXMenuItemSelected
-Menu item selected element: AXRole: AXMenuItem
-Menu item selected element description: AXDescription: item3
-
-PASS successfullyParsed is true
-
-TEST COMPLETE
-
+#EOF
+#EOF

[Radar WebKit Bug Importer]

<rdar://problem/59605517>

[Jason Lawrence]

I have marked this test as slow while this issue is being investigated.
https://trac.webkit.org/changeset/256950/webkit

[Jason Lawrence]

I am able to reproduce this issue with r256933 by using the command below.
run-webkit-tests accessibility/mac/aria-menu-item-selected-notification.html --iterations 4000 --exit-after-n-failures 5 -f --force

[1068/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
[1068/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
[1085/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
[1210/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
[1269/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
Exiting early after 5 failures. 1266 tests run.


1261 tests ran as expected, 5 didn't (2734 didn't run):