Bug 134576 – [GTK] Layout Tests media/track/track-cue-rendering.html, media/track/video/video-track-mkv-theora* and media/track/audio/audio-track-mkv-vorbis-language.html are failing

• Component: Tools / Tests
• Status: NEW

[Carlos Alberto Lopez Perez]

The following layout test is flaky on platform GTK

media/track/video/video-track-mkv-theora-selected.html

When it fails, the diff is the following: http://build.webkit.org/results/GTK%20Linux%2064-bit%20Release%20%28Tests%29/r170557%20%281123%29/media/track/video/video-track-mkv-theora-selected-pretty-diff.html

[Carlos Alberto Lopez Perez]

The test  media/track/video/video-track-mkv-theora-language.html is also flaky, giving the following failure sometimes: http://build.webkit.org/results/GTK%20Linux%2064-bit%20Release%20%28Tests%29/r170904%20%281303%29/media/track/video/video-track-mkv-theora-language-pretty-diff.html

[Carlos Alberto Lopez Perez]

media/track/audio/audio-track-mkv-vorbis-language.html also fails sometimes with a similar failure: http://build.webkit.org/results/GTK%20Linux%2064-bit%20Release%20%28Tests%29/r170900%20%281299%29/media/track/audio/audio-track-mkv-vorbis-language-pretty-diff.html

[Carlos Alberto Lopez Perez]

media/track/track-cue-rendering.html is also flaky.

When it fails gives: http://build.webkit.org/results/GTK%20Linux%2064-bit%20Release%20%28Tests%29/r170894%20%281295%29/media/track/track-cue-rendering-pretty-diff.html

[Philippe Normand]

Please copy-paste results instead of buildbot links that expire after some time.

[Diego Pino]

None of these tests are flakey anymore. Current status is:

media/track/audio/audio-track-mkv-vorbis-language.html [ Failure ]
media/track/video/video-track-mkv-theora-selected.html [ Timeout ]
media/track/video/video-track-mkv-theora-language.html [ Failure ]

Diffs:

https://build.webkit.org/results/GTK-Linux-64-bit-Release-Tests/r278650%20%282224%29/media/track/audio/audio-track-mkv-vorbis-language-diff.txt

--- /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/audio/audio-track-mkv-vorbis-language-expected.txt
+++ /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/audio/audio-track-mkv-vorbis-language-actual.txt
@@ -5,8 +5,8 @@
 
 ** Check in-band kind attributes
 EXPECTED (video.audioTracks.length == '2') OK
-EXPECTED (video.audioTracks[0].language == 'la') OK
-EXPECTED (video.audioTracks[1].language == 'en') OK
+EXPECTED (video.audioTracks[0].language == 'la'), OBSERVED 'en' FAIL
+EXPECTED (video.audioTracks[1].language == 'en'), OBSERVED 'la' FAIL
 
 END OF TEST

 
https://build.webkit.org/results/GTK-Linux-64-bit-Release-Tests/r278651%20%282225%29/media/track/video/video-track-mkv-theora-selected-diff.txt

--- /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/video/video-track-mkv-theora-selected-expected.txt
+++ /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/video/video-track-mkv-theora-selected-actual.txt
@@ -1,20 +1,2 @@
+FAIL: Timed out waiting for notifyDone to be called
 
-Test audio track enabled attributes.
-
-EVENT(canplaythrough)
-EXPECTED (video.videoTracks.length == '2') OK
-RUN(track1 = video.videoTracks[0])
-RUN(track2 = video.videoTracks[1])
-
-** Checking initial state
-EXPECTED (track1.selected == 'true') OK
-EXPECTED (track2.selected == 'false') OK
-EXPECTED (video.videoTracks.selectedIndex == '0') OK
-
-** If we select one track, the other should be deselected
-RUN(track2.selected = true)
-EXPECTED (track1.selected == 'false') OK
-EXPECTED (track2.selected == 'true') OK
-EXPECTED (video.videoTracks.selectedIndex == '1') OK
-END OF TEST
-

https://build.webkit.org/results/GTK-Linux-64-bit-Release-Tests/r278651%20%282225%29/media/track/video/video-track-mkv-theora-language-diff.txt


--- /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/video/video-track-mkv-theora-language-expected.txt
+++ /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/video/video-track-mkv-theora-language-actual.txt
@@ -5,8 +5,8 @@
 
 ** Check in-band kind attributes
 EXPECTED (video.videoTracks.length == '2') OK
-EXPECTED (video.videoTracks[0].language == 'ru') OK
-EXPECTED (video.videoTracks[1].language == 'zh') OK
+EXPECTED (video.videoTracks[0].language == 'ru'), OBSERVED 'zh' FAIL
+EXPECTED (video.videoTracks[1].language == 'zh'), OBSERVED 'ru' FAIL
 
 END OF TEST

[Arcady Goldmints-Orlov]

media/track/audio/audio-track-mkv-vorbis-language.html and media/track/video/video-track-mkv-theora-language.html were fixed by r278860 as part of bug 226864. media/track/video/video-track-mkv-theora-selected.html continues to time out.

[Arcady Goldmints-Orlov]

media/track/video/video-track-mkv-theora-selected.html is now a failure:

--- /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/video/video-track-mkv-theora-selected-expected.txt
+++ /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/video/video-track-mkv-theora-selected-actual.txt
@@ -13,8 +13,8 @@
 
 ** If we select one track, the other should be deselected
 RUN(track2.selected = true)
-EXPECTED (track1.selected == 'false') OK
+EXPECTED (track1.selected == 'false'), OBSERVED 'true' FAIL
 EXPECTED (track2.selected == 'true') OK
-EXPECTED (video.videoTracks.selectedIndex == '1') OK
+EXPECTED (video.videoTracks.selectedIndex == '1'), OBSERVED '0' FAIL
 END OF TEST