Bug 229474 - REGRESSION (r281182?): [BigSur wk2] 4 Media tests flakily timing out
Summary: REGRESSION (r281182?): [BigSur wk2] 4 Media tests flakily timing out
Status: RESOLVED CONFIGURATION CHANGED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Media (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-08-24 15:49 PDT by Eric Hutchison
Modified: 2022-07-26 12:24 PDT (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Eric Hutchison 2021-08-24 15:49:59 PDT
media/modern-media-controls/tracks-support/text-track-selected-via-media-api.html
media/modern-media-controls/tracks-support/auto-text-track.html
media/modern-media-controls/tracks-support/hidden-tracks.html
media/modern-media-controls/tracks-support/off-text-track.html

are flakily timing out on BigSur wk2.


History: https://results.webkit.org/?platform=ios&platform=mac&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=media%2Fmodern-media-controls%2Ftracks-support%2Ftext-track-selected-via-media-api.html&test=media%2Fmodern-media-controls%2Ftracks-support%2Foff-text-track.html&test=media%2Fmodern-media-controls%2Ftracks-support%2Fhidden-tracks.html&test=media%2Fmodern-media-controls%2Ftracks-support%2Fauto-text-track.html

Results: https://build.webkit.org/results/Apple-BigSur-Debug-AppleSilicon-WK2-Tests/r281184%20(2600)/results.html; https://build.webkit.org/results/Apple-BigSur-Release-AppleSilicon-WK2-Tests/r281197%20(3271)/results.html; https://build.webkit.org/results/Apple-BigSur-Debug-AppleSilicon-WK2-Tests/r281210%20(2609)/results.html; https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r281198%20(4546)/results.html

Diff:
--- /Volumes/Data/worker/bigsur-debug-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/text-track-selected-via-media-api-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/text-track-selected-via-media-api-actual.txt
@@ -1,21 +1,8 @@
+FAIL: Timed out waiting for notifyDone to be called

-------------------------
--- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/hidden-tracks-expected.txt
+++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/hidden-tracks-actual.txt
@@ -1,15 +1,8 @@
+FAIL: Timed out waiting for notifyDone to be called
+

-------------------------
--- /Volumes/Data/worker/bigsur-debug-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/off-text-track-expected.txt
+++ /Volumes/Data/worker/bigsur-debug-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/off-text-track-actual.txt
@@ -1,14 +1,8 @@
+FAIL: Timed out waiting for notifyDone to be called
+
-------------------------
--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/auto-text-track-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/auto-text-track-actual.txt
@@ -1,16 +1,8 @@
+FAIL: Timed out waiting for notifyDone to be called
+

https://trac.webkit.org/changeset/281182/webkit
Comment 1 Radar WebKit Bug Importer 2021-08-24 15:50:38 PDT
<rdar://problem/82313889>
Comment 2 Radar WebKit Bug Importer 2021-08-24 15:51:46 PDT
<rdar://problem/82313927>
Comment 3 Eric Hutchison 2021-08-24 15:59:17 PDT
Updated test expectations at https://trac.webkit.org/changeset/281522/webkit.
Comment 4 Radar WebKit Bug Importer 2021-08-24 15:59:31 PDT
<rdar://problem/82314269>
Comment 5 Eric Hutchison 2021-08-26 11:05:56 PDT
Updated test expectations at https://trac.webkit.org/changeset/281635/webkit.
Comment 6 Ryan Haddad 2021-08-26 15:37:37 PDT
(In reply to Eric Hutchison from comment #5)
> Updated test expectations at https://trac.webkit.org/changeset/281635/webkit.
This appears to have caused two tests to start running (and fail) on Catalina:
media/modern-media-controls/tracks-support/auto-text-track.html
media/modern-media-controls/tracks-support/hidden-tracks.html

It looks like they are only expected to pass on BigSur+
LayoutTests/platform/mac-wk2/TestExpectations:24:[ BigSur+ ] media/modern-media-controls/tracks-support [ Pass ]
Comment 7 Brent Fulgham 2022-06-23 14:00:34 PDT
This is no longer happening as reported. But there is a consistent timeout on iOS, and a flaky failure (related to localizations?) on macOS. We need new bugs about those.
Comment 8 EWS 2022-07-26 12:24:31 PDT
Test gardening commit 252841@main (1c2334cf2453): <https://commits.webkit.org/252841@main>

Reviewed commits have been landed. Closing PR #2747 and removing active labels.