Bug 137505

Summary: Layout Test media/track/track-forced-subtitles-in-band.html is flaky
Product: WebKit Reporter: Jer Noble <jer.noble>
Component: Tools / TestsAssignee: Jer Noble <jer.noble>
Status: NEW ---    
Severity: Normal CC: buildbot, calvaris, cdumez, commit-queue, eric.carlson, glenn, philipj, rniwa, sergio
Priority: P2    
Version: 528+ (Nightly build)   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=124219
https://bugs.webkit.org/show_bug.cgi?id=242804
Bug Depends on: 137472, 137525    
Bug Blocks:    
Attachments:
Description Flags
Patch
buildbot: commit-queue-
Archive of layout-test-results from webkit-ews-14 for mac-mountainlion-wk2
none
Archive of layout-test-results from webkit-ews-04 for mac-mountainlion
none
Patch for landing none

Description Jer Noble 2014-10-07 16:07:15 PDT 
The following layout test is flaky on [insert platform]

media/track/track-forced-subtitles-in-band.html

Probable cause:

http://trac.webkit.org/r174402
Comment 1 Jer Noble 2014-10-07 16:07:37 PDT 
[insert platform] = Mac
Comment 2 Jer Noble 2014-10-07 16:11:22 PDT 
Created attachment 239439 [details]
Patch
Comment 3 Build Bot 2014-10-07 17:05:50 PDT 
Comment on attachment 239439 [details]
Patch

Attachment 239439 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.appspot.com/results/5238909596336128

New failing tests:
media/video-controls-audiotracks-trackmenu.html
Comment 4 Build Bot 2014-10-07 17:05:54 PDT 
Created attachment 239442 [details]
Archive of layout-test-results from webkit-ews-14 for mac-mountainlion-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: webkit-ews-14  Port: mac-mountainlion-wk2  Platform: Mac OS X 10.8.5
Comment 5 Build Bot 2014-10-07 17:57:57 PDT 
Comment on attachment 239439 [details]
Patch

Attachment 239439 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.appspot.com/results/4526222050590720

New failing tests:
media/video-controls-audiotracks-trackmenu.html
Comment 6 Build Bot 2014-10-07 17:58:02 PDT 
Created attachment 239443 [details]
Archive of layout-test-results from webkit-ews-04 for mac-mountainlion

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: webkit-ews-04  Port: mac-mountainlion  Platform: Mac OS X 10.8.5
Comment 7 Jer Noble 2014-10-08 11:24:53 PDT 
Created attachment 239481 [details]
Patch for landing
Comment 8 WebKit Commit Bot 2014-10-08 13:04:36 PDT 
Comment on attachment 239481 [details]
Patch for landing

Clearing flags on attachment: 239481

Committed r174472: <http://trac.webkit.org/changeset/174472>
Comment 9 Alexey Proskuryakov 2014-10-20 20:15:43 PDT 
Unfortunately, the test is still flaky.
Comment 10 Alexey Proskuryakov 2015-01-19 12:22:25 PST 
It fails like this:

-EXPECTED (video.textTracks[3].activeCues.length == '1') OK
-EXPECTED (textTrackDisplayElement(video, 'cue') != 'null') OK
+EXPECTED (video.textTracks[3].activeCues.length == '1'), OBSERVED '0' FAIL
+No text track cue with display id 'cue' is currently visible

This is reproducible for me locally with:

run-webkit-tests media/track/track-forced-subtitles-in-band.html --repeat 100 -f
Comment 11 Alexey Proskuryakov 2015-02-17 00:08:00 PST 
The test also sometimes times out.