Bug 198081 – [Mac] Layout Test imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/track/track-element/track-remove-track.html is a flaky failure

• Status: NEW
• Component: Tools / Tests

[Shawn Roberts]

The following layout test is failing on Mac Release and Debug WK1 and WK2

imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/track/track-element/track-remove-track.html

Probable cause:

Test appears to have been flaky for a very long time. Dashboard shows flaky failures on every queue for Debug runs and Release WK1. Release runs for WK2 are showing up recently, but local testing shows the same Harness Error (TIMEOUT) for all Mac test platforms

Reproduced with the old revision I could spade.

run-webkit-tests imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/track/track-element/track-remove-track.html --iter 100 -f -1

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fembedded-content%2Fmedia-elements%2Ftrack%2Ftrack-element%2Ftrack-remove-track.html

Diff:

--- /Volumes/Data/slave/mojave-release-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/track/track-element/track-remove-track-expected.txt
+++ /Volumes/Data/slave/mojave-release-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/track/track-element/track-remove-track-actual.txt
@@ -1,3 +1,5 @@
 
-PASS Tests that the 'removetrack' event is fired when an out-of-band TextTrack is removed. 
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Tests that the 'removetrack' event is fired when an out-of-band TextTrack is removed. Test timed out
+

[Radar WebKit Bug Importer]

<rdar://problem/50996996>