Bug 256108 – New test: [macOS] media/video-audio-session-mode.html is a constant text failure

• Status: NEW
• Component: Media

[Robert Jenner]

media/video-audio-session-mode.htm

is a constant text failure on macOS Monterey and higher.

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=webaudio%2Faudiocontext-low-samplerate.html

TEXT DIFF:
 RUN(video.pause())
 RUN(video.muted = true)
 EXPECTED (internals.audioSessionCategory() == 'MoviePlayback'), OBSERVED 'MediaPlayback' FAIL
-EXPECTED (internals.audioSessionMode() == 'Default') OK
+EXPECTED (internals.audioSessionMode() == 'Default'), OBSERVED 'MoviePlayback' FAIL
 EXPECTED (internals.routeSharingPolicy() == 'LongFormAudio') OK
 
 ** And check again after 3 seconds.
-EXPECTED (internals.audioSessionCategory() == 'None') OK
-EXPECTED (internals.routeSharingPolicy() == 'Default') OK
+EXPECTED (internals.audioSessionCategory() == 'None'), OBSERVED 'MediaPlayback' FAIL
+EXPECTED (internals.routeSharingPolicy() == 'Default'), OBSERVED 'LongFormAudio' FAIL
 END OF TEST
 

DIFF URL:
https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/263510@main%20(2966)/media/video-audio-session-mode-pretty-diff.html


This is a newly introduced test that has been failing since its introduction at https://commits.webkit.org/263201@main

[Radar WebKit Bug Importer]

<rdar://problem/108675835>

[Robert Jenner]

This does not reproduce standalone. But it does reproduce in a test list every time running at Ventura Debug ToT as follows:

run-webkit-tests --test-list <path_to_test_list.txt_goes_here>

So this appears to be a test list ordering issue. 

I have attached the test list used for repo do this bug.

[Robert Jenner]

Created attachment 466134 [details]
Test list used for reproduction case

[Robert Jenner]

So far not appears that when the following tests run BEFORE 'media/video-audio-session-mode.html' it causes said test to fail:

media/remoteplayback-cancel-invalid.html
media/remoteplayback-target-availability.html
media/remoteplayback-watch-availability-gc.html
media/remoteplayback-watch-disableremoteplayback.html
media/remoteplayback-prompt.html


When those tests are removed from the test list, 'media/video-audio-session-mode.htm' passes.

[EWS]

Test gardening commit 263523@main (2dd3036f6702): <https://commits.webkit.org/263523@main>

Reviewed commits have been landed. Closing PR #13297 and removing active labels.