Bug 116293 – media/video-seek-after-end.html is flaky

• Status: NEW
• Component: Media

[Ryosuke Niwa]

http://webkit-test-results.appspot.com/dashboards/flakiness_dashboard.html#tests=media%2Fvideo-seek-after-end.html

This test is flaky everywhere :(

[Philippe Normand]

Adding test author.

[Ryosuke Niwa]

Added a test expectation in http://trac.webkit.org/changeset/150244.

[Balazs Kelemen]

Thanks for handling it. Will look into the problem (at some point).

[Alexey Proskuryakov]

Any update on this?

[Balazs Kelemen]

Created attachment 230335 [details]
Patch

[Build Bot]

Comment on attachment 230335 [details]
Patch

Attachment 230335 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.appspot.com/results/5110776352210944

New failing tests:
media/video-seek-after-end.html

[Build Bot]

Created attachment 230341 [details]
Archive of layout-test-results from webkit-ews-16 for mac-mountainlion-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: webkit-ews-16  Port: mac-mountainlion-wk2  Platform: Mac OS X 10.8.5

[Build Bot]

Comment on attachment 230335 [details]
Patch

Attachment 230335 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.appspot.com/results/5627717810651136

New failing tests:
media/video-seek-after-end.html

[Build Bot]

Created attachment 230344 [details]
Archive of layout-test-results from webkit-ews-05 for mac-mountainlion

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: webkit-ews-05  Port: mac-mountainlion  Platform: Mac OS X 10.8.5

[Build Bot]

Comment on attachment 230335 [details]
Patch

Attachment 230335 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.appspot.com/results/5467203608510464

New failing tests:
media/video-seek-after-end.html

[Build Bot]

Created attachment 230346 [details]
Archive of layout-test-results from webkit-ews-12 for mac-mountainlion-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: webkit-ews-12  Port: mac-mountainlion-wk2  Platform: Mac OS X 10.8.5

[Build Bot]

Comment on attachment 230335 [details]
Patch

Attachment 230335 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.appspot.com/results/5178906613121024

New failing tests:
media/video-seek-after-end.html

[Build Bot]

Created attachment 230348 [details]
Archive of layout-test-results from webkit-ews-04 for mac-mountainlion

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: webkit-ews-04  Port: mac-mountainlion  Platform: Mac OS X 10.8.5

[Balazs Kelemen]

Created attachment 230396 [details]
Patch

[Balazs Kelemen]

Better if I change the expectation as well, let's try this again.

[Balazs Kelemen]

Greenness, happiness. Please review.

[Csaba Osztrogonác]

(In reply to comment #16)
> Greenness, happiness. Please review.

Will it fix this kind of failures? 

--- /Volumes/Data/slave/mavericks-debug-tests-wk1/build/layout-test-results/media/video-seek-after-end-expected.txt
+++ /Volumes/Data/slave/mavericks-debug-tests-wk1/build/layout-test-results/media/video-seek-after-end-actual.txt
@@ -2,9 +2,6 @@
 
 
 EVENT(playing)
-EVENT(ended)
-EVENT(seeked)
-EVENT(playing)
-EXPECTED (video.currentTime.toFixed(2) == '3') OK
+FAIL: timeout FAIL
 END OF TEST

[Balazs Kelemen]

(In reply to comment #17)
> (In reply to comment #16)
> > Greenness, happiness. Please review.
> 
> Will it fix this kind of failures? 
> 
> --- /Volumes/Data/slave/mavericks-debug-tests-wk1/build/layout-test-results/media/video-seek-after-end-expected.txt
> +++ /Volumes/Data/slave/mavericks-debug-tests-wk1/build/layout-test-results/media/video-seek-after-end-actual.txt
> @@ -2,9 +2,6 @@
> 
> 
>  EVENT(playing)
> -EVENT(ended)
> -EVENT(seeked)
> -EVENT(playing)
> -EXPECTED (video.currentTime.toFixed(2) == '3') OK
> +FAIL: timeout FAIL
>  END OF TEST

No, but where do you see this? This should never happen if the bot is functioning normally.

[Balazs Kelemen]

(In reply to comment #18)
> (In reply to comment #17)
> > (In reply to comment #16)
> > > Greenness, happiness. Please review.
> > 
> > Will it fix this kind of failures? 
> > 
> > --- /Volumes/Data/slave/mavericks-debug-tests-wk1/build/layout-test-results/media/video-seek-after-end-expected.txt
> > +++ /Volumes/Data/slave/mavericks-debug-tests-wk1/build/layout-test-results/media/video-seek-after-end-actual.txt
> > @@ -2,9 +2,6 @@
> > 
> > 
> >  EVENT(playing)
> > -EVENT(ended)
> > -EVENT(seeked)
> > -EVENT(playing)
> > -EXPECTED (video.currentTime.toFixed(2) == '3') OK
> > +FAIL: timeout FAIL
> >  END OF TEST
> 
> No, but where do you see this? This should never happen if the bot is functioning normally.

Ah, ok, I found it. Not sure what to do, I have no clue how can this happen, or how can any media test not fail if that can happen. I need to think about it.

[Balazs Kelemen]

Comment on attachment 230396 [details]
Patch

This is not ready yet to fix all issues seen on bots.

[Ahmad Saleem]

Still marked as 'flaky':

https://searchfox.org/wubkat/source/LayoutTests/TestExpectations#1352