Bug 186055 - [macOS WK2 Release] Layout Test media/video-trackmenu-selection.html is flaky
Summary: [macOS WK2 Release] Layout Test media/video-trackmenu-selection.html is flaky
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2018-05-29 10:17 PDT by Dawei Fenton (:realdawei)
Modified: 2018-06-06 13:52 PDT (History)
6 users (show)

See Also:


Attachments
Mark test as flaky. (1.44 KB, patch)
2018-06-06 13:23 PDT, Dawei Fenton (:realdawei)
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Dawei Fenton (:realdawei) 2018-05-29 10:17:06 PDT
The following test is flay on macOS Sierra Release WK2

media/video-trackmenu-selection.html
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Fvideo-trackmenu-selection.html%20

sample diff:
--- /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/media/video-trackmenu-selection-expected.txt
+++ /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/media/video-trackmenu-selection-actual.txt
@@ -6,34 +6,6 @@
 *** Set the user's preferred language to English, enable automatic caption selection.
 RUN(internals.setUserPreferredLanguages(['en']))
 RUN(internals.setCaptionDisplayMode('AlwaysOn'))
-
-** The preferred language is set to English, but the Spanish track should be enabled because it is available
-Track menu:
-0: "Off"
-1: "Auto (Recommended)"
-2: "Spanish", checked
-EXPECTED (video.textTracks[0].mode == 'showing') OK
-
-*** Add a text track in the preferred language.
-RUN(track = document.createElement('track'))
-RUN(track.setAttribute('kind', 'captions'))
-RUN(track.src = 'data:text/vtt,WEBVTT%0A%0A00%3A00%3A00.000%20--%3E%2000%3A00%3A01.000%0ACaption%201%0A')
-RUN(track.setAttribute('srclang', 'en'))
-RUN(track.setAttribute('onload', 'trackLoaded()'))
-RUN(video.appendChild(track))
-
-EVENT(load)
-
-*** The new track should be selected because it is in the preferred language.
-EXPECTED (event.target.srclang == 'en') OK
-EXPECTED (event.target.readyState == '2') OK
-EXPECTED (video.textTracks[0].mode == 'disabled') OK
-EXPECTED (video.textTracks[1].mode == 'showing') OK
-Track menu:
-0: "Off"
-1: "Auto (Recommended)"
-2: "English", checked
-3: "Spanish"
-
+clickCCButton failed with exception: "undefined: FAIL
 END OF TEST
Comment 1 Dawei Fenton (:realdawei) 2018-06-06 13:23:15 PDT
Created attachment 342077 [details]
Mark test as flaky.
Comment 2 Ryan Haddad 2018-06-06 13:51:16 PDT
Comment on attachment 342077 [details]
Mark test as flaky.

Clearing flags on attachment: 342077

Committed r232558: <https://trac.webkit.org/changeset/232558>