Bug 134576 - [GTK] Layout Tests media/track/track-cue-rendering.html, media/track/video/video-track-mkv-theora* and media/track/audio/audio-track-mkv-vorbis-language.html are failing
Summary: [GTK] Layout Tests media/track/track-cue-rendering.html, media/track/video/vi...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2014-07-02 18:06 PDT by Carlos Alberto Lopez Perez
Modified: 2021-09-17 11:11 PDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Carlos Alberto Lopez Perez 2014-07-02 18:06:45 PDT
The following layout test is flaky on platform GTK

media/track/video/video-track-mkv-theora-selected.html

When it fails, the diff is the following: http://build.webkit.org/results/GTK%20Linux%2064-bit%20Release%20%28Tests%29/r170557%20%281123%29/media/track/video/video-track-mkv-theora-selected-pretty-diff.html
Comment 1 Carlos Alberto Lopez Perez 2014-07-09 03:34:11 PDT
The test  media/track/video/video-track-mkv-theora-language.html is also flaky, giving the following failure sometimes: http://build.webkit.org/results/GTK%20Linux%2064-bit%20Release%20%28Tests%29/r170904%20%281303%29/media/track/video/video-track-mkv-theora-language-pretty-diff.html
Comment 2 Carlos Alberto Lopez Perez 2014-07-09 04:26:51 PDT
media/track/audio/audio-track-mkv-vorbis-language.html also fails sometimes with a similar failure: http://build.webkit.org/results/GTK%20Linux%2064-bit%20Release%20%28Tests%29/r170900%20%281299%29/media/track/audio/audio-track-mkv-vorbis-language-pretty-diff.html
Comment 3 Carlos Alberto Lopez Perez 2014-07-09 05:51:55 PDT
media/track/track-cue-rendering.html is also flaky.

When it fails gives: http://build.webkit.org/results/GTK%20Linux%2064-bit%20Release%20%28Tests%29/r170894%20%281295%29/media/track/track-cue-rendering-pretty-diff.html
Comment 4 Philippe Normand 2018-03-02 03:23:52 PST
Please copy-paste results instead of buildbot links that expire after some time.
Comment 5 Diego Pino 2021-06-09 01:52:03 PDT
None of these tests are flakey anymore. Current status is:

media/track/audio/audio-track-mkv-vorbis-language.html [ Failure ]
media/track/video/video-track-mkv-theora-selected.html [ Timeout ]
media/track/video/video-track-mkv-theora-language.html [ Failure ]

Diffs:

https://build.webkit.org/results/GTK-Linux-64-bit-Release-Tests/r278650%20%282224%29/media/track/audio/audio-track-mkv-vorbis-language-diff.txt

--- /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/audio/audio-track-mkv-vorbis-language-expected.txt
+++ /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/audio/audio-track-mkv-vorbis-language-actual.txt
@@ -5,8 +5,8 @@
 
 ** Check in-band kind attributes
 EXPECTED (video.audioTracks.length == '2') OK
-EXPECTED (video.audioTracks[0].language == 'la') OK
-EXPECTED (video.audioTracks[1].language == 'en') OK
+EXPECTED (video.audioTracks[0].language == 'la'), OBSERVED 'en' FAIL
+EXPECTED (video.audioTracks[1].language == 'en'), OBSERVED 'la' FAIL
 
 END OF TEST

 
https://build.webkit.org/results/GTK-Linux-64-bit-Release-Tests/r278651%20%282225%29/media/track/video/video-track-mkv-theora-selected-diff.txt

--- /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/video/video-track-mkv-theora-selected-expected.txt
+++ /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/video/video-track-mkv-theora-selected-actual.txt
@@ -1,20 +1,2 @@
+FAIL: Timed out waiting for notifyDone to be called
 
-Test audio track enabled attributes.
-
-EVENT(canplaythrough)
-EXPECTED (video.videoTracks.length == '2') OK
-RUN(track1 = video.videoTracks[0])
-RUN(track2 = video.videoTracks[1])
-
-** Checking initial state
-EXPECTED (track1.selected == 'true') OK
-EXPECTED (track2.selected == 'false') OK
-EXPECTED (video.videoTracks.selectedIndex == '0') OK
-
-** If we select one track, the other should be deselected
-RUN(track2.selected = true)
-EXPECTED (track1.selected == 'false') OK
-EXPECTED (track2.selected == 'true') OK
-EXPECTED (video.videoTracks.selectedIndex == '1') OK
-END OF TEST
-

https://build.webkit.org/results/GTK-Linux-64-bit-Release-Tests/r278651%20%282225%29/media/track/video/video-track-mkv-theora-language-diff.txt


--- /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/video/video-track-mkv-theora-language-expected.txt
+++ /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/video/video-track-mkv-theora-language-actual.txt
@@ -5,8 +5,8 @@
 
 ** Check in-band kind attributes
 EXPECTED (video.videoTracks.length == '2') OK
-EXPECTED (video.videoTracks[0].language == 'ru') OK
-EXPECTED (video.videoTracks[1].language == 'zh') OK
+EXPECTED (video.videoTracks[0].language == 'ru'), OBSERVED 'zh' FAIL
+EXPECTED (video.videoTracks[1].language == 'zh'), OBSERVED 'ru' FAIL
 
 END OF TEST
Comment 6 Arcady Goldmints-Orlov 2021-06-28 13:30:21 PDT
media/track/audio/audio-track-mkv-vorbis-language.html and media/track/video/video-track-mkv-theora-language.html were fixed by r278860 as part of bug 226864. media/track/video/video-track-mkv-theora-selected.html continues to time out.
Comment 7 Arcady Goldmints-Orlov 2021-09-17 11:11:27 PDT
media/track/video/video-track-mkv-theora-selected.html is now a failure:

--- /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/video/video-track-mkv-theora-selected-expected.txt
+++ /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/media/track/video/video-track-mkv-theora-selected-actual.txt
@@ -13,8 +13,8 @@
 
 ** If we select one track, the other should be deselected
 RUN(track2.selected = true)
-EXPECTED (track1.selected == 'false') OK
+EXPECTED (track1.selected == 'false'), OBSERVED 'true' FAIL
 EXPECTED (track2.selected == 'true') OK
-EXPECTED (video.videoTracks.selectedIndex == '1') OK
+EXPECTED (video.videoTracks.selectedIndex == '1'), OBSERVED '0' FAIL
 END OF TEST