Bug 239634

Summary: [ macOS wk2 arm64 ] media/modern-media-controls/tracks-support/text-track-selected-via-media-api.html is a flaky failure
Product: WebKit Reporter: Karl Rackler <rackler>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: REOPENED ---    
Severity: Normal CC: hi, jer.noble, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=263257

Description Karl Rackler 2022-04-21 18:01:35 PDT
Description:
media/modern-media-controls/tracks-support/text-track-selected-via-media-api.html

The first failure that I saw on the dashboard was 3/18/2022 at r291467, with the next not until 3/28/2022 at r292014 on Big Sur.  
The first failure that I saw on the dashboard was 3/29/2022 at r292056 on Monterey. 

The regression point could possibly be 267467-267466, although I was unable to reproduce it.  The failures for Big Sur arm64 continue after that commit range and then continue with Monterey arm64.

The test was added 03/16/2021 at Canonical link: https://commits.webkit.org/235372@main | git-svn-id: https://svn.webkit.org/repository/webkit/trunk@274521 268f45cc-cd09-0410-ab3c-d52691b4dbfc

History:
https://results.webkit.org/?suite=layout-tests&test=media%2Fmodern-media-controls%2Ftracks-support%2Ftext-track-selected-via-media-api.html&platform=mac&limit=50000&architecture=arm64

Diff:
--- /Volumes/Data/worker/monterey-release-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/text-track-selected-via-media-api-expected.txt
+++ /Volumes/Data/worker/monterey-release-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/text-track-selected-via-media-api-actual.txt
@@ -7,14 +7,14 @@
 PASS shadowRoot.querySelector('button.tracks').getBoundingClientRect().width became different from 0
 Setting mode to 'showing' for 'English' text track via JavaScript...
 Tapping tracks button...
-PASS contextmenuItem('English').checked is true
-PASS contextmenuItem('French').checked is undefined.
+FAIL contextmenuItem('English').checked should be true. Threw exception TypeError: undefined is not an object (evaluating 'contextmenuItem('English').checked')
+FAIL contextmenuItem('French').checked should be undefined. Threw exception TypeError: undefined is not an object (evaluating 'contextmenuItem('French').checked')
 Selecting 'French' text track...
-PASS subtitleTrack('en').mode is 'disabled'
-PASS subtitleTrack('fr').mode is 'showing'
+FAIL subtitleTrack('en').mode should be disabled. Was showing.
+FAIL subtitleTrack('fr').mode should be showing. Was disabled.
 Tapping tracks button...
-PASS contextmenuItem('English').checked is undefined.
-PASS contextmenuItem('French').checked is true
+FAIL contextmenuItem('English').checked should be undefined. Threw exception TypeError: undefined is not an object (evaluating 'contextmenuItem('English').checked')
+FAIL contextmenuItem('French').checked should be true. Threw exception TypeError: undefined is not an object (evaluating 'contextmenuItem('French').checked')
 PASS successfullyParsed is true
 
 TEST COMPLETE
Comment 1 Radar WebKit Bug Importer 2022-04-21 18:01:51 PDT
<rdar://problem/92133806>
Comment 2 Karl Rackler 2022-04-21 18:17:04 PDT
Pull request: https://github.com/WebKit/WebKit/pull/355
Comment 3 Karl Rackler 2022-04-21 18:18:26 PDT
I have marked this test as a flaky failure while this issue is investigated.
Comment 4 EWS 2022-04-21 18:21:55 PDT
Committed r293204 (249875@main): <https://commits.webkit.org/249875@main>

Reviewed commits have been landed. Closing PR #355 and removing active labels.
Comment 5 Karl Rackler 2022-04-21 18:22:10 PDT
Reopened because the issue is still being investigated.