Bug 137505 - Layout Test media/track/track-forced-subtitles-in-band.html is flaky
Summary: Layout Test media/track/track-forced-subtitles-in-band.html is flaky
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Jer Noble
URL:
Keywords:
Depends on: 137472 137525
Blocks:
  Show dependency treegraph
 
Reported: 2014-10-07 16:07 PDT by Jer Noble
Modified: 2015-03-10 19:46 PDT (History)
9 users (show)

See Also:


Attachments
Patch (1.65 KB, patch)
2014-10-07 16:11 PDT, Jer Noble
buildbot: commit-queue-
Details | Formatted Diff | Diff
Archive of layout-test-results from webkit-ews-14 for mac-mountainlion-wk2 (479.26 KB, application/zip)
2014-10-07 17:05 PDT, Build Bot
no flags Details
Archive of layout-test-results from webkit-ews-04 for mac-mountainlion (613.00 KB, application/zip)
2014-10-07 17:58 PDT, Build Bot
no flags Details
Patch for landing (13.87 KB, patch)
2014-10-08 11:24 PDT, Jer Noble
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Jer Noble 2014-10-07 16:07:15 PDT
The following layout test is flaky on [insert platform]

media/track/track-forced-subtitles-in-band.html

Probable cause:

http://trac.webkit.org/r174402
Comment 1 Jer Noble 2014-10-07 16:07:37 PDT
[insert platform] = Mac
Comment 2 Jer Noble 2014-10-07 16:11:22 PDT
Created attachment 239439 [details]
Patch
Comment 3 Build Bot 2014-10-07 17:05:50 PDT
Comment on attachment 239439 [details]
Patch

Attachment 239439 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.appspot.com/results/5238909596336128

New failing tests:
media/video-controls-audiotracks-trackmenu.html
Comment 4 Build Bot 2014-10-07 17:05:54 PDT
Created attachment 239442 [details]
Archive of layout-test-results from webkit-ews-14 for mac-mountainlion-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: webkit-ews-14  Port: mac-mountainlion-wk2  Platform: Mac OS X 10.8.5
Comment 5 Build Bot 2014-10-07 17:57:57 PDT
Comment on attachment 239439 [details]
Patch

Attachment 239439 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.appspot.com/results/4526222050590720

New failing tests:
media/video-controls-audiotracks-trackmenu.html
Comment 6 Build Bot 2014-10-07 17:58:02 PDT
Created attachment 239443 [details]
Archive of layout-test-results from webkit-ews-04 for mac-mountainlion

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: webkit-ews-04  Port: mac-mountainlion  Platform: Mac OS X 10.8.5
Comment 7 Jer Noble 2014-10-08 11:24:53 PDT
Created attachment 239481 [details]
Patch for landing
Comment 8 WebKit Commit Bot 2014-10-08 13:04:36 PDT
Comment on attachment 239481 [details]
Patch for landing

Clearing flags on attachment: 239481

Committed r174472: <http://trac.webkit.org/changeset/174472>
Comment 9 Alexey Proskuryakov 2014-10-20 20:15:43 PDT
Unfortunately, the test is still flaky.
Comment 10 Alexey Proskuryakov 2015-01-19 12:22:25 PST
It fails like this:

-EXPECTED (video.textTracks[3].activeCues.length == '1') OK
-EXPECTED (textTrackDisplayElement(video, 'cue') != 'null') OK
+EXPECTED (video.textTracks[3].activeCues.length == '1'), OBSERVED '0' FAIL
+No text track cue with display id 'cue' is currently visible

This is reproducible for me locally with:

run-webkit-tests media/track/track-forced-subtitles-in-band.html --repeat 100 -f
Comment 11 Alexey Proskuryakov 2015-02-17 00:08:00 PST
The test also sometimes times out.