Bug 239634 – [ macOS wk2 arm64 ] media/modern-media-controls/tracks-support/text-track-selected-via-media-api.html is a flaky failure

• Status: REOPENED
• Component: New Bugs

[Karl Rackler]

Description:
media/modern-media-controls/tracks-support/text-track-selected-via-media-api.html

The first failure that I saw on the dashboard was 3/18/2022 at r291467, with the next not until 3/28/2022 at r292014 on Big Sur.  
The first failure that I saw on the dashboard was 3/29/2022 at r292056 on Monterey. 

The regression point could possibly be 267467-267466, although I was unable to reproduce it.  The failures for Big Sur arm64 continue after that commit range and then continue with Monterey arm64.

The test was added 03/16/2021 at Canonical link: https://commits.webkit.org/235372@main | git-svn-id: https://svn.webkit.org/repository/webkit/trunk@274521 268f45cc-cd09-0410-ab3c-d52691b4dbfc

History:
https://results.webkit.org/?suite=layout-tests&test=media%2Fmodern-media-controls%2Ftracks-support%2Ftext-track-selected-via-media-api.html&platform=mac&limit=50000&architecture=arm64

Diff:
--- /Volumes/Data/worker/monterey-release-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/text-track-selected-via-media-api-expected.txt
+++ /Volumes/Data/worker/monterey-release-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/text-track-selected-via-media-api-actual.txt
@@ -7,14 +7,14 @@
 PASS shadowRoot.querySelector('button.tracks').getBoundingClientRect().width became different from 0
 Setting mode to 'showing' for 'English' text track via JavaScript...
 Tapping tracks button...
-PASS contextmenuItem('English').checked is true
-PASS contextmenuItem('French').checked is undefined.
+FAIL contextmenuItem('English').checked should be true. Threw exception TypeError: undefined is not an object (evaluating 'contextmenuItem('English').checked')
+FAIL contextmenuItem('French').checked should be undefined. Threw exception TypeError: undefined is not an object (evaluating 'contextmenuItem('French').checked')
 Selecting 'French' text track...
-PASS subtitleTrack('en').mode is 'disabled'
-PASS subtitleTrack('fr').mode is 'showing'
+FAIL subtitleTrack('en').mode should be disabled. Was showing.
+FAIL subtitleTrack('fr').mode should be showing. Was disabled.
 Tapping tracks button...
-PASS contextmenuItem('English').checked is undefined.
-PASS contextmenuItem('French').checked is true
+FAIL contextmenuItem('English').checked should be undefined. Threw exception TypeError: undefined is not an object (evaluating 'contextmenuItem('English').checked')
+FAIL contextmenuItem('French').checked should be true. Threw exception TypeError: undefined is not an object (evaluating 'contextmenuItem('French').checked')
 PASS successfullyParsed is true
 
 TEST COMPLETE

[Radar WebKit Bug Importer]

<rdar://problem/92133806>

[Karl Rackler]

Pull request: https://github.com/WebKit/WebKit/pull/355

[Karl Rackler]

I have marked this test as a flaky failure while this issue is investigated.

[EWS]

Committed r293204 (249875@main): <https://commits.webkit.org/249875@main>

Reviewed commits have been landed. Closing PR #355 and removing active labels.

[Karl Rackler]

Reopened because the issue is still being investigated.