Bug 228189

Summary:	[ Mac ] http/tests/media/hls/hls-webvtt-seek-backwards.html is a flaky timeout.
Product:	WebKit	Reporter:	Eric Hutchison <ehutchison>
Component:	Media	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	ayumi_kojima, ehutchison, eric.carlson, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Eric Hutchison 2021-07-22 11:04:45 PDT

http/tests/media/hls/hls-webvtt-seek-backwards.html

is a flaky timeout on Mac wk2 and Catalina Debug GPUProcess since r279169.

History: https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fmedia%2Fhls%2Fhls-webvtt-seek-backwards.html&platform=ios&platform=mac

Diff:

--- /Volumes/Data/worker/bigsur-debug-tests-wk2/build/layout-test-results/http/tests/media/hls/hls-webvtt-seek-backwards-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-tests-wk2/build/layout-test-results/http/tests/media/hls/hls-webvtt-seek-backwards-actual.txt
@@ -1,17 +1,5 @@
+#PID UNRESPONSIVE - WebKitTestRunner (pid 82587)
+FAIL: Timed out waiting for notifyDone to be called
 
-RUN(video.play())
-EVENT(addtrack)
-EXPECTED (video.textTracks.length == '1') OK
-RUN(video.textTracks[0].mode = 'showing')
-EVENT(cuechange)
-EXPECTED (video.textTracks[0].activeCues.length == '1') OK
-EXPECTED (video.textTracks[0].activeCues[0].text == 'Subtitle Test') OK
-RUN(video.currentTime = 9.5)
-EVENT(ended)
-RUN(video.currentTime = 0)
-RUN(video.play())
-EVENT(cuechange)
-EXPECTED (video.textTracks[0].activeCues.length == '1') OK
-EXPECTED (video.textTracks[0].activeCues[0].text == 'Subtitle Test') OK
-END OF TEST
-
+#EOF
+#EOF

Reproduced timeout on r280173, r279193 with run-webkit-tests --debug -f
 --clobber-old-results --exit-after-n-crashes-or-timeouts 1 --exit-after-n-failures 2 --iterations 500 http/tests/media/hls/hls-webvtt-seek-backwards.html.

Comment 1 Radar WebKit Bug Importer 2021-07-22 11:05:28 PDT

<rdar://problem/80971644>

Comment 2 Eric Hutchison 2021-07-22 11:27:26 PDT

Updated expectations at https://trac.webkit.org/changeset/280189/webkit.

Comment 3 ayumi_kojima 2021-08-27 09:33:20 PDT

The timeout is showing up on macOS-Catalina-Release-WK1-Tests-EWS as a flaky test. Looking at the history, the test is still flaky timing out on Catalina. Added [ Catalina+ ] to the expectations to see if this will work. https://trac.webkit.org/changeset/281696/webkit

Comment 4 ayumi_kojima 2021-08-30 13:45:09 PDT

Moved test expectation from Mac-wk2 to Mac so that the flakiness on Catalina wk1 won't show up. https://trac.webkit.org/changeset/281772/webkit