Bug 186055

Summary: [macOS WK2 Release] Layout Test media/video-trackmenu-selection.html is flaky
Product: WebKit Reporter: Dawei Fenton (:realdawei) <realdawei>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: ap, eric.carlson, jeremyj-wk, jer.noble, lforschler, ryanhaddad
Priority: P2    
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Mark test as flaky. none

Description Dawei Fenton (:realdawei) 2018-05-29 10:17:06 PDT
The following test is flay on macOS Sierra Release WK2

media/video-trackmenu-selection.html
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Fvideo-trackmenu-selection.html%20

sample diff:
--- /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/media/video-trackmenu-selection-expected.txt
+++ /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/media/video-trackmenu-selection-actual.txt
@@ -6,34 +6,6 @@
 *** Set the user's preferred language to English, enable automatic caption selection.
 RUN(internals.setUserPreferredLanguages(['en']))
 RUN(internals.setCaptionDisplayMode('AlwaysOn'))
-
-** The preferred language is set to English, but the Spanish track should be enabled because it is available
-Track menu:
-0: "Off"
-1: "Auto (Recommended)"
-2: "Spanish", checked
-EXPECTED (video.textTracks[0].mode == 'showing') OK
-
-*** Add a text track in the preferred language.
-RUN(track = document.createElement('track'))
-RUN(track.setAttribute('kind', 'captions'))
-RUN(track.src = 'data:text/vtt,WEBVTT%0A%0A00%3A00%3A00.000%20--%3E%2000%3A00%3A01.000%0ACaption%201%0A')
-RUN(track.setAttribute('srclang', 'en'))
-RUN(track.setAttribute('onload', 'trackLoaded()'))
-RUN(video.appendChild(track))
-
-EVENT(load)
-
-*** The new track should be selected because it is in the preferred language.
-EXPECTED (event.target.srclang == 'en') OK
-EXPECTED (event.target.readyState == '2') OK
-EXPECTED (video.textTracks[0].mode == 'disabled') OK
-EXPECTED (video.textTracks[1].mode == 'showing') OK
-Track menu:
-0: "Off"
-1: "Auto (Recommended)"
-2: "English", checked
-3: "Spanish"
-
+clickCCButton failed with exception: "undefined: FAIL
 END OF TEST
Comment 1 Dawei Fenton (:realdawei) 2018-06-06 13:23:15 PDT
Created attachment 342077 [details]
Mark test as flaky.
Comment 2 Ryan Haddad 2018-06-06 13:51:16 PDT
Comment on attachment 342077 [details]
Mark test as flaky.

Clearing flags on attachment: 342077

Committed r232558: <https://trac.webkit.org/changeset/232558>