Bug 229478

Summary:	REGRESSION (r281102?): [ Mac ] media/track/track-in-band.html is a flaky timeout.
Product:	WebKit	Reporter:	Eric Hutchison <ehutchison>
Component:	Media	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED CONFIGURATION CHANGED
Severity:	Normal	CC:	ayumi_kojima, bfulgham, ehutchison, hi, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Eric Hutchison 2021-08-24 16:58:33 PDT

media/track/track-in-band.html

is a flaky timeout on Catalina and BigSur wk2.

History: https://results.webkit.org/?platform=ios&platform=mac&suite=layout-tests&test=media%2Ftrack%2Ftrack-in-band.html

Results: https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r281514%20(4698)/results.html

Diff:
--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/media/track/track-in-band-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/media/track/track-in-band-actual.txt
@@ -1,3 +1,5 @@
+FAIL: Timed out waiting for notifyDone to be called
+
 
 In-band text tracks.
 
@@ -13,36 +15,4 @@
 EVENT(addtrack)
 EXPECTED (event.track == 'video.textTracks[3]') OK
 
-EVENT(canplaythrough)
 
-** Check initial in-band track states
-EXPECTED (video.textTracks.length == '4') OK
-RUN(inbandTrack1 = video.textTracks[0])
-RUN(inbandTrack2 = video.textTracks[1])
-RUN(inbandTrack3 = video.textTracks[2])
-RUN(inbandTrack4 = video.textTracks[3])
-EXPECTED (inbandTrack1.language == 'en') OK
-EXPECTED (inbandTrack1.kind == 'subtitles') OK
-EXPECTED (inbandTrack2.language == 'en') OK
-EXPECTED (inbandTrack2.kind == 'forced') OK
-EXPECTED (inbandTrack3.language == 'fr') OK
-EXPECTED (inbandTrack3.kind == 'subtitles') OK
-EXPECTED (inbandTrack4.language == 'fr') OK
-EXPECTED (inbandTrack4.kind == 'forced') OK
-
-** Add two tracks, check sort order
-RUN(addTrack = video.addTextTrack('captions', 'Caption Track', 'en'))
-RUN(trackElement = document.createElement('track'))
-RUN(video.appendChild(trackElement))
-EXPECTED (video.textTracks.length == '6') OK
-EXPECTED (video.textTracks[0] == 'trackElement.track') OK
-EXPECTED (video.textTracks[1] == 'addTrack') OK
-EXPECTED (video.textTracks[2] == 'inbandTrack1') OK
-EXPECTED (video.textTracks[3] == 'inbandTrack2') OK
-
-** Unload video file, check track count
-RUN(video.src = '')
-EXPECTED (video.textTracks.length == '2') OK
-
-END OF TEST
-

First instance of timeout seen at r281102.

Comment 1 Radar WebKit Bug Importer 2021-08-24 16:58:58 PDT

<rdar://problem/82316805>

Comment 2 Eric Hutchison 2021-08-24 17:03:55 PDT

Updated test expectations at https://trac.webkit.org/changeset/281532/webkit.

Comment 3 Eric Hutchison 2021-09-14 18:29:32 PDT

Reproduced test results locally on r282390 using run-webkit-tests --debug --force -f --iterations 500 --exit-after-n-crashes-or-timeouts 1 --clobber-old-results media/track/track-in-band.html

Comment 4 ayumi_kojima 2021-09-20 09:57:55 PDT

The flaky time out is seen on Mac wk1 release as well. Updated test expectations: https://trac.webkit.org/changeset/282753/webkit

Comment 5 Brent Fulgham 2022-06-23 14:01:13 PDT

Operations confirmed this is no longer happening (5/3/2022)