Bug 172291 – [macOS Debug][WK2] Layout test media/controls/airplay-controls.html is flaky

• Status: NEW
• Component: New Bugs

[Matt Lewis]

The test media/controls/airplay-controls.html is a flaky timeout on Sierra and El Capitan WK2 Debug.

The test has only recently become flaky according to dashboard. First fail shown is on 5/12/2017 with build: 
https://build.webkit.org/builders/Apple%20El%20Capitan%20Debug%20WK2%20(Tests)/builds/1068

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Fcontrols%2Fairplay-controls.html

https://build.webkit.org/results/Apple%20El%20Capitan%20Debug%20WK2%20(Tests)/r217046%20(1201)/results.html
https://build.webkit.org/builders/Apple%20El%20Capitan%20Debug%20WK2%20(Tests)/builds/1201

Diff:
--- /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/media/controls/airplay-controls-expected.txt
+++ /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/media/controls/airplay-controls-actual.txt
@@ -1,21 +1 @@
-This tests that showing the wireless device placeholder does not show controls.
-
-This test only runs in DRT!
-
-
-EVENT: canplaythrough
-
-Test initial state
-
-PASS: We are using the apple idiom
-PASS: video.controls should be false
-PASS: Controls should not be visible
-
-Select an AppleTV device
-
-PASS: Placeholder is visible
-PASS: Placeholder has classname 'appletv'
-PASS: Controls should not be visible
-
-Testing finished.
-
+<unknown> - TestController::run - Failed to reset state to consistent values

[Matt Lewis]

I was able to reproduce locally on Sierra Debug with:
run-webkit-tests media/controls/airplay-controls.html  --iterations=500 -f --debug --no-retry-failure -g

[Alexey Proskuryakov]

I can't reproduce this specific failure when doing this; instead I get a different timeout:

+#PID UNRESPONSIVE - com.apple.WebKit.WebContent.Development (pid 16856)
+FAIL: Timed out waiting for notifyDone to be called