Bug 229474 – REGRESSION (r281182?): [BigSur wk2] 4 Media tests flakily timing out

• Status: RESOLVED
• Resolution: CONFIGURATION CHANGED
• Component: Media

[Eric Hutchison]

media/modern-media-controls/tracks-support/text-track-selected-via-media-api.html
media/modern-media-controls/tracks-support/auto-text-track.html
media/modern-media-controls/tracks-support/hidden-tracks.html
media/modern-media-controls/tracks-support/off-text-track.html

are flakily timing out on BigSur wk2.


History: https://results.webkit.org/?platform=ios&platform=mac&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=media%2Fmodern-media-controls%2Ftracks-support%2Ftext-track-selected-via-media-api.html&test=media%2Fmodern-media-controls%2Ftracks-support%2Foff-text-track.html&test=media%2Fmodern-media-controls%2Ftracks-support%2Fhidden-tracks.html&test=media%2Fmodern-media-controls%2Ftracks-support%2Fauto-text-track.html

Results: https://build.webkit.org/results/Apple-BigSur-Debug-AppleSilicon-WK2-Tests/r281184%20(2600)/results.html; https://build.webkit.org/results/Apple-BigSur-Release-AppleSilicon-WK2-Tests/r281197%20(3271)/results.html; https://build.webkit.org/results/Apple-BigSur-Debug-AppleSilicon-WK2-Tests/r281210%20(2609)/results.html; https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r281198%20(4546)/results.html

Diff:
--- /Volumes/Data/worker/bigsur-debug-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/text-track-selected-via-media-api-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/text-track-selected-via-media-api-actual.txt
@@ -1,21 +1,8 @@
+FAIL: Timed out waiting for notifyDone to be called

-------------------------
--- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/hidden-tracks-expected.txt
+++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/hidden-tracks-actual.txt
@@ -1,15 +1,8 @@
+FAIL: Timed out waiting for notifyDone to be called
+

-------------------------
--- /Volumes/Data/worker/bigsur-debug-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/off-text-track-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/off-text-track-actual.txt
@@ -1,14 +1,8 @@
+FAIL: Timed out waiting for notifyDone to be called
+
-------------------------
--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/auto-text-track-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/auto-text-track-actual.txt
@@ -1,16 +1,8 @@
+FAIL: Timed out waiting for notifyDone to be called
+

https://trac.webkit.org/changeset/281182/webkit

[Radar WebKit Bug Importer]

<rdar://problem/82313889>

[Radar WebKit Bug Importer]

<rdar://problem/82313927>

[Eric Hutchison]

Updated test expectations at https://trac.webkit.org/changeset/281522/webkit.

[Radar WebKit Bug Importer]

<rdar://problem/82314269>

[Eric Hutchison]

Updated test expectations at https://trac.webkit.org/changeset/281635/webkit.

[Ryan Haddad]

(In reply to Eric Hutchison from comment #5)
> Updated test expectations at https://trac.webkit.org/changeset/281635/webkit.
This appears to have caused two tests to start running (and fail) on Catalina:
media/modern-media-controls/tracks-support/auto-text-track.html
media/modern-media-controls/tracks-support/hidden-tracks.html

It looks like they are only expected to pass on BigSur+
LayoutTests/platform/mac-wk2/TestExpectations:24:[ BigSur+ ] media/modern-media-controls/tracks-support [ Pass ]

[Brent Fulgham]

This is no longer happening as reported. But there is a consistent timeout on iOS, and a flaky failure (related to localizations?) on macOS. We need new bugs about those.

[EWS]

Test gardening commit 252841@main (1c2334cf2453): <https://commits.webkit.org/252841@main>

Reviewed commits have been landed. Closing PR #2747 and removing active labels.