Bug 228334 - [ iOS ] media/track/track-forced-subtitles-in-band.html is a flaky timeout
Summary: [ iOS ] media/track/track-forced-subtitles-in-band.html is a flaky timeout
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-07-27 10:57 PDT by ayumi_kojima
Modified: 2022-07-15 17:37 PDT (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description ayumi_kojima 2021-07-27 10:57:39 PDT
media/track/track-forced-subtitles-in-band.html

Is a flaky timeout on iOS 14 E Simulator wk2.

History: https://results.webkit.org/?suite=layout-tests&test=media%2Ftrack%2Ftrack-forced-subtitles-in-band.html

Diff: 

--- /Volumes/Data/worker/ipados-simulator-14-release-tests-wk2/build/layout-test-results/media/track/track-forced-subtitles-in-band-expected.txt
+++ /Volumes/Data/worker/ipados-simulator-14-release-tests-wk2/build/layout-test-results/media/track/track-forced-subtitles-in-band-actual.txt
@@ -1,58 +1,4 @@
-Tests that forced subtitles are enable automatically.
+#PID UNRESPONSIVE - WebKitTestRunnerApp (pid 55989)
+FAIL: Timed out waiting for notifyDone to be called
 
-
-RUN(internals.settings.setShouldDisplayTrackKind('Captions', false))
-RUN(internals.settings.setShouldDisplayTrackKind('Subtitles', true))
-RUN(internals.setUserPreferredLanguages(['en']))
-RUN(internals.setPrimaryAudioTrackLanguageOverride('fr'))
-RUN(internals.setCaptionDisplayMode('ForcedOnly'))
-EVENT(canplaythrough)
-
-** Forced tracks should be in .textTracks, but not in the menu
-EXPECTED (video.textTracks.length == '9') OK
-
-** Only the 'fr' forced track should be showing
-EXPECTED (video.textTracks[0].language == 'en') OK
-EXPECTED (video.textTracks[0].kind == 'subtitles') OK
-EXPECTED (video.textTracks[0].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[1].language == 'en') OK
-EXPECTED (video.textTracks[1].kind == 'forced') OK
-EXPECTED (video.textTracks[1].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[2].language == 'fr') OK
-EXPECTED (video.textTracks[2].kind == 'subtitles') OK
-EXPECTED (video.textTracks[2].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[3].language == 'fr') OK
-EXPECTED (video.textTracks[3].kind == 'forced') OK
-EXPECTED (video.textTracks[3].mode == 'showing') OK
-
-EXPECTED (video.textTracks[4].language == 'es') OK
-EXPECTED (video.textTracks[4].kind == 'subtitles') OK
-EXPECTED (video.textTracks[4].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[5].language == 'es') OK
-EXPECTED (video.textTracks[5].kind == 'forced') OK
-EXPECTED (video.textTracks[5].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[6].language == 'de') OK
-EXPECTED (video.textTracks[6].kind == 'subtitles') OK
-EXPECTED (video.textTracks[6].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[7].language == 'de') OK
-EXPECTED (video.textTracks[7].kind == 'forced') OK
-EXPECTED (video.textTracks[7].mode == 'disabled') OK
-
-EXPECTED (video.textTracks[8].language == 'en') OK
-EXPECTED (video.textTracks[8].kind == 'captions') OK
-EXPECTED (video.textTracks[8].mode == 'disabled') OK
-
-RUN(video.currentTime = 9.5)
-
-EVENT(seeked)
-EVENT(cuechange)
-EXPECTED (video.textTracks[3].activeCues.length == '1') OK
-
-END OF TEST
-
+#EOF
Comment 1 ayumi_kojima 2021-07-27 11:44:07 PDT
This timeouts are also reported here:
https://bugs.webkit.org/show_bug.cgi?id=137505
rdar://52700185

The flaky timeouts reported above might be related to the one I see this time because it seems that the bug has never been fixed.

I was able to reproduce the timeout on iOS 15 simulator on my local machine using:

run-webkit-tests --ios-simulator --iterations 500  --exit-after-n-failures 2 --exit-after-n-crashes-or-timeouts 2 media/track/track-forced-subtitles-in-band.html
Comment 2 Radar WebKit Bug Importer 2021-07-27 11:46:31 PDT
<rdar://problem/81174158>
Comment 3 ayumi_kojima 2021-07-27 11:55:47 PDT
Updated test expectations https://trac.webkit.org/changeset/280348/webkit