Bug 186055 – [macOS WK2 Release] Layout Test media/video-trackmenu-selection.html is flaky

• Status: RESOLVED
• Resolution: CONFIGURATION CHANGED
• Component: Tools / Tests

[Dawei Fenton (:realdawei)]

The following test is flay on macOS Sierra Release WK2

media/video-trackmenu-selection.html
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Fvideo-trackmenu-selection.html%20

sample diff:
--- /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/media/video-trackmenu-selection-expected.txt
+++ /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/media/video-trackmenu-selection-actual.txt
@@ -6,34 +6,6 @@
 *** Set the user's preferred language to English, enable automatic caption selection.
 RUN(internals.setUserPreferredLanguages(['en']))
 RUN(internals.setCaptionDisplayMode('AlwaysOn'))
-
-** The preferred language is set to English, but the Spanish track should be enabled because it is available
-Track menu:
-0: "Off"
-1: "Auto (Recommended)"
-2: "Spanish", checked
-EXPECTED (video.textTracks[0].mode == 'showing') OK
-
-*** Add a text track in the preferred language.
-RUN(track = document.createElement('track'))
-RUN(track.setAttribute('kind', 'captions'))
-RUN(track.src = 'data:text/vtt,WEBVTT%0A%0A00%3A00%3A00.000%20--%3E%2000%3A00%3A01.000%0ACaption%201%0A')
-RUN(track.setAttribute('srclang', 'en'))
-RUN(track.setAttribute('onload', 'trackLoaded()'))
-RUN(video.appendChild(track))
-
-EVENT(load)
-
-*** The new track should be selected because it is in the preferred language.
-EXPECTED (event.target.srclang == 'en') OK
-EXPECTED (event.target.readyState == '2') OK
-EXPECTED (video.textTracks[0].mode == 'disabled') OK
-EXPECTED (video.textTracks[1].mode == 'showing') OK
-Track menu:
-0: "Off"
-1: "Auto (Recommended)"
-2: "English", checked
-3: "Spanish"
-
+clickCCButton failed with exception: "undefined: FAIL
 END OF TEST

[Dawei Fenton (:realdawei)]

Created attachment 342077 [details]
Mark test as flaky.

[Ryan Haddad]

Comment on attachment 342077 [details]
Mark test as flaky.

Clearing flags on attachment: 342077

Committed r232558: <https://trac.webkit.org/changeset/232558>

[Ahmad Saleem]

Deleted in this commit:

https://github.com/WebKit/WebKit/commit/a39bd42ad87d82a3bea0fa6eac107376a973cf7c

> * media/video-trackmenu-selection.html: Removed.

Nothing to do here.