Bug 137505 - Layout Test media/track/track-forced-subtitles-in-band.html is flaky
Summary: Layout Test media/track/track-forced-subtitles-in-band.html is flaky
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Jer Noble
URL:
Keywords:
Depends on: 137472 137525
Blocks:
  Show dependency tree / graph
 
Reported: 2014-10-07 16:07 PDT by Jer Noble
Modified: 2022-07-15 17:37 PDT (History)
9 users (show)

See Also:

Attachments
Patch (1.65 KB, patch)
2014-10-07 16:11 PDT, Jer Noble 		buildbot: commit-queue-
Details | Formatted Diff | Diff
Archive of layout-test-results from webkit-ews-14 for mac-mountainlion-wk2 (479.26 KB, application/zip)
2014-10-07 17:05 PDT, Build Bot 		no flags Details
Archive of layout-test-results from webkit-ews-04 for mac-mountainlion (613.00 KB, application/zip)
2014-10-07 17:58 PDT, Build Bot 		no flags Details
Patch for landing (13.87 KB, patch)
2014-10-08 11:24 PDT, Jer Noble 		no flags Details | Formatted Diff | Diff
Show Obsolete (1) View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Jer Noble 2014-10-07 16:07:15 PDT 
The following layout test is flaky on [insert platform]

media/track/track-forced-subtitles-in-band.html

Probable cause:

http://trac.webkit.org/r174402
Comment 1 Jer Noble 2014-10-07 16:07:37 PDT 
[insert platform] = Mac
Comment 2 Jer Noble 2014-10-07 16:11:22 PDT 
Created attachment 239439 [details]
Patch
Comment 3 Build Bot 2014-10-07 17:05:50 PDT 
Comment on attachment 239439 [details]
Patch

Attachment 239439 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.appspot.com/results/5238909596336128

New failing tests:
media/video-controls-audiotracks-trackmenu.html
Comment 4 Build Bot 2014-10-07 17:05:54 PDT 
Created attachment 239442 [details]
Archive of layout-test-results from webkit-ews-14 for mac-mountainlion-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: webkit-ews-14  Port: mac-mountainlion-wk2  Platform: Mac OS X 10.8.5
Comment 5 Build Bot 2014-10-07 17:57:57 PDT 
Comment on attachment 239439 [details]
Patch

Attachment 239439 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.appspot.com/results/4526222050590720

New failing tests:
media/video-controls-audiotracks-trackmenu.html
Comment 6 Build Bot 2014-10-07 17:58:02 PDT 
Created attachment 239443 [details]
Archive of layout-test-results from webkit-ews-04 for mac-mountainlion

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: webkit-ews-04  Port: mac-mountainlion  Platform: Mac OS X 10.8.5
Comment 7 Jer Noble 2014-10-08 11:24:53 PDT 
Created attachment 239481 [details]
Patch for landing
Comment 8 WebKit Commit Bot 2014-10-08 13:04:36 PDT 
Comment on attachment 239481 [details]
Patch for landing

Clearing flags on attachment: 239481

Committed r174472: <http://trac.webkit.org/changeset/174472>
Comment 9 Alexey Proskuryakov 2014-10-20 20:15:43 PDT 
Unfortunately, the test is still flaky.
Comment 10 Alexey Proskuryakov 2015-01-19 12:22:25 PST 
It fails like this:

-EXPECTED (video.textTracks[3].activeCues.length == '1') OK
-EXPECTED (textTrackDisplayElement(video, 'cue') != 'null') OK
+EXPECTED (video.textTracks[3].activeCues.length == '1'), OBSERVED '0' FAIL
+No text track cue with display id 'cue' is currently visible

This is reproducible for me locally with:

run-webkit-tests media/track/track-forced-subtitles-in-band.html --repeat 100 -f
Comment 11 Alexey Proskuryakov 2015-02-17 00:08:00 PST 
The test also sometimes times out.