207962 2020-02-19 14:16:35 -0800 [ Mac wk2 ] accessibility/mac/aria-menu-item-selected-notification.html is flaky timing out. 2020-02-19 14:31:59 -0800 1 1 1 Unclassified WebKit Accessibility WebKit Nightly Build Mac macOS 10.15 NEW InRadar P2 Normal --- 1 Lawrence.j webkit-unassigned webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1620859 0 Lawrence.j 2020-02-19 14:16:35 -0800 accessibility/mac/aria-menu-item-selected-notification.html Description: This test is flaky timing out on Mac wk2. The oldest timeout that I see is r251108, the oldest that I can load with a matching diff is r255863. History: https://results.webkit.org/?suite=layout-tests&test=accessibility%2Fmac%2Faria-menu-item-selected-notification.html&flavor=wk2&style=release&limit=50000 Diff: --- /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/accessibility/mac/aria-menu-item-selected-notification-expected.txt +++ /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/accessibility/mac/aria-menu-item-selected-notification-actual.txt @@ -1,25 +1,5 @@ -Menu item 1 -Menu item 2 -Menu item 3 -This tests that a AXMenuItemSelected notification gets fired when a menuitem is focused. +#PID UNRESPONSIVE - WebKitTestRunner (pid 52130) +FAIL: Timed out waiting for notifyDone to be called -On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE". - - -PASS addedNotification is true -Received menu item selected notification: AXMenuItemSelected -Menu item selected element: AXRole: AXMenuItem -Menu item selected element description: AXDescription: item1 - -Received menu item selected notification: AXMenuItemSelected -Menu item selected element: AXRole: AXMenuItem -Menu item selected element description: AXDescription: item2 - -Received menu item selected notification: AXMenuItemSelected -Menu item selected element: AXRole: AXMenuItem -Menu item selected element description: AXDescription: item3 - -PASS successfullyParsed is true - -TEST COMPLETE - +#EOF +#EOF 1620860 1 webkit-bug-importer 2020-02-19 14:16:50 -0800 <rdar://problem/59605517> 1620861 2 Lawrence.j 2020-02-19 14:20:28 -0800 I have marked this test as slow while this issue is being investigated. https://trac.webkit.org/changeset/256950/webkit 1620869 3 Lawrence.j 2020-02-19 14:31:59 -0800 I am able to reproduce this issue with r256933 by using the command below. run-webkit-tests accessibility/mac/aria-menu-item-selected-notification.html --iterations 4000 --exit-after-n-failures 5 -f --force [1068/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff) [1068/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff) [1085/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff) [1210/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff) [1269/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff) Exiting early after 5 failures. 1266 tests run. 1261 tests ran as expected, 5 didn't (2734 didn't run):