Bug 171814 - [El Capitan Release] Layout Test http/tests/media/hls/video-controls-live-stream.html is flaky
Summary: [El Capitan Release] Layout Test http/tests/media/hls/video-controls-live-str...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
: 172199 (view as bug list)
Depends on:
Blocks:
 
Reported: 2017-05-08 10:53 PDT by Matt Lewis
Modified: 2017-05-17 13:11 PDT (History)
8 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Matt Lewis 2017-05-08 10:53:48 PDT
the test http/tests/media/hls/video-controls-live-stream.html is a flaky failure.

History:
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&revision=215968&tests=http%2Ftests%2Fmedia%2Fhls%2Fvideo-controls-live-stream.html

Build:
https://build.webkit.org/builders/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/builds/1320

Diff:
--- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/media/hls/video-controls-live-stream-expected.txt
+++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/http/tests/media/hls/video-controls-live-stream-actual.txt
@@ -1,30 +1,4 @@
 
-EVENT(canplaythrough)
-EVENT(play)
-EXPECTED (video.duration == 'Infinity') OK
--webkit-media-text-track-container: classes: [hidden]
--webkit-media-show-controls: classes: []
--webkit-media-controls-current-time-display: classes: [clone six-digit-time]
--webkit-media-controls-time-remaining-display: classes: [clone six-digit-time]
--webkit-media-controls-wireless-playback-status: classes: [hidden]
--webkit-media-controls-wireless-playback-text: classes: []
--webkit-media-controls-wireless-playback-text-top: classes: []
--webkit-media-controls-wireless-playback-text-bottom: classes: []
--webkit-media-controls-panel: classes: [show paused]
--webkit-media-controls-panel-background-container: classes: []
--webkit-media-controls-panel-background: classes: [show paused]
--webkit-media-controls-panel-tint: classes: []
--webkit-media-controls-play-button: classes: [paused]
--webkit-media-controls-status-display: classes: []
-none: classes: [mute-box]
--webkit-media-controls-volume-slider-container: classes: [volume-box uses-ltr-user-interface-layout-direction]
--webkit-media-controls-volume-slider-container-background: classes: []
--webkit-media-controls-volume-slider-container-tint: classes: []
--webkit-media-controls-volume-slider: classes: []
--webkit-media-controls-mute-button: classes: []
--webkit-media-controls-wireless-playback-picker-button: classes: [hidden]
--webkit-media-controls-toggle-closed-captions-button: classes: [hidden]
--webkit-media-controls-fullscreen-button: classes: []
-TEST(timeline == null || timeline.disabled) OK
+EVENT(stalled) TEST(false) FAIL
 END OF TEST
Comment 1 Matt Lewis 2017-05-12 17:31:28 PDT
was able to reproduce locally with:
run-webkit-tests http/tests/media/hls/video-controls-live-stream.html -f --iterations=500 --no-retry-failure -g
Comment 2 Alexey Proskuryakov 2017-05-12 19:12:27 PDT
Nice!

What OS did you reproduce this with? I'm guessing it wasn't El Capitan, but I don't know for sure. Was the diff the same?
Comment 3 Ryan Haddad 2017-05-17 10:46:51 PDT
*** Bug 172199 has been marked as a duplicate of this bug. ***
Comment 4 Ryan Haddad 2017-05-17 10:51:53 PDT
This test is frequently failing on EWS, but the flakiness dashboard does not show any flakes on macOS bots for the past 4 days.
Comment 5 Ryan Haddad 2017-05-17 11:19:18 PDT
(In reply to Ryan Haddad from comment #4)
> This test is frequently failing on EWS, but the flakiness dashboard does not
> show any flakes on macOS bots for the past 4 days.

A similar diff is seen with http/tests/media/hls/video-duration-accessibility.html, which frequently fails alongside this test on EWS.
Comment 6 Ryan Haddad 2017-05-17 11:29:51 PDT
(In reply to Ryan Haddad from comment #5)
> (In reply to Ryan Haddad from comment #4)
> > This test is frequently failing on EWS, but the flakiness dashboard does not
> > show any flakes on macOS bots for the past 4 days.
> 
> A similar diff is seen with
> http/tests/media/hls/video-duration-accessibility.html, which frequently
> fails alongside this test on EWS.

Marked both of these tests as failing on mac-wk1 so EWS won't be affected while we investigate the root cause: http://trac.webkit.org/projects/webkit/changeset/216984
Comment 7 Radar WebKit Bug Importer 2017-05-17 13:11:17 PDT
<rdar://problem/32255366>