Bug 228334 – [ iOS ] media/track/track-forced-subtitles-in-band.html is a flaky timeout

• Status: NEW
• Component: Tools / Tests

media/track/track-forced-subtitles-in-band.html

Is a flaky timeout on iOS 14 E Simulator wk2.

History: https://results.webkit.org/?suite=layout-tests&test=media%2Ftrack%2Ftrack-forced-subtitles-in-band.html

Diff: 

--- /Volumes/Data/worker/ipados-simulator-14-release-tests-wk2/build/layout-test-results/media/track/track-forced-subtitles-in-band-expected.txt
+++ /Volumes/Data/worker/ipados-simulator-14-release-tests-wk2/build/layout-test-results/media/track/track-forced-subtitles-in-band-actual.txt
@@ -1,58 +1,4 @@
-Tests that forced subtitles are enable automatically.
+#PID UNRESPONSIVE - WebKitTestRunnerApp (pid 55989)
+FAIL: Timed out waiting for notifyDone to be called
 
-
-RUN(internals.settings.setShouldDisplayTrackKind('Captions', false))
-RUN(internals.settings.setShouldDisplayTrackKind('Subtitles', true))
-RUN(internals.setUserPreferredLanguages(['en']))
-RUN(internals.setPrimaryAudioTrackLanguageOverride('fr'))
-RUN(internals.setCaptionDisplayMode('ForcedOnly'))
-EVENT(canplaythrough)
-
-** Forced tracks should be in .textTracks, but not in the menu
-EXPECTED (video.textTracks.length == '9') OK
-
-** Only the 'fr' forced track should be showing
-EXPECTED (video.textTracks[0].language == 'en') OK
-EXPECTED (video.textTracks[0].kind == 'subtitles') OK
-EXPECTED (video.textTracks[0].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[1].language == 'en') OK
-EXPECTED (video.textTracks[1].kind == 'forced') OK
-EXPECTED (video.textTracks[1].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[2].language == 'fr') OK
-EXPECTED (video.textTracks[2].kind == 'subtitles') OK
-EXPECTED (video.textTracks[2].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[3].language == 'fr') OK
-EXPECTED (video.textTracks[3].kind == 'forced') OK
-EXPECTED (video.textTracks[3].mode == 'showing') OK
-
-EXPECTED (video.textTracks[4].language == 'es') OK
-EXPECTED (video.textTracks[4].kind == 'subtitles') OK
-EXPECTED (video.textTracks[4].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[5].language == 'es') OK
-EXPECTED (video.textTracks[5].kind == 'forced') OK
-EXPECTED (video.textTracks[5].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[6].language == 'de') OK
-EXPECTED (video.textTracks[6].kind == 'subtitles') OK
-EXPECTED (video.textTracks[6].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[7].language == 'de') OK
-EXPECTED (video.textTracks[7].kind == 'forced') OK
-EXPECTED (video.textTracks[7].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[8].language == 'en') OK
-EXPECTED (video.textTracks[8].kind == 'captions') OK
-EXPECTED (video.textTracks[8].mode == 'disabled') OK
-
-RUN(video.currentTime = 9.5)
-
-EVENT(seeked)
-EVENT(cuechange)
-EXPECTED (video.textTracks[3].activeCues.length == '1') OK
-
-END OF TEST
-
+#EOF

This timeouts are also reported here:
https://bugs.webkit.org/show_bug.cgi?id=137505
rdar://52700185

The flaky timeouts reported above might be related to the one I see this time because it seems that the bug has never been fixed.

I was able to reproduce the timeout on iOS 15 simulator on my local machine using:

run-webkit-tests --ios-simulator --iterations 500  --exit-after-n-failures 2 --exit-after-n-crashes-or-timeouts 2 media/track/track-forced-subtitles-in-band.html

[Radar WebKit Bug Importer]

<rdar://problem/81174158>

Updated test expectations https://trac.webkit.org/changeset/280348/webkit