Bug 296631 – [ macOS wk2 ] 4x imported/w3c/web-platform-tests/webcodecs/ tests (layout-tests) is a constant text failure and flakey text failure

• Status: NEW
• Component: Media

[Bryan Medina]

imported/w3c/web-platform-tests/webcodecs/video-encoder-h26x-annexb.https.any.worker.html?h265_annexb_software
imported/w3c/web-platform-tests/webcodecs/video-encoder-h26x-annexb.https.any.worker.html?h265_annexb_hardware
imported/w3c/web-platform-tests/webcodecs/video-encoder-h26x-annexb.https.any.html?h265_annexb_software
imported/w3c/web-platform-tests/webcodecs/video-encoder-h26x-annexb.https.any.html?h265_annexb_hardware

are constant text failures on Sonoma wk2 arm64 and on Sequoia wk2 arm64 was flakey but is starting to becoming constant as well.


HISTORY:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebcodecs%2Fvideo-encoder-h26x-annexb.https.any.worker.html%3Fh265_annexb_software&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebcodecs%2Fvideo-encoder-h26x-annexb.https.any.worker.html%3Fh265_annexb_hardware&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebcodecs%2Fvideo-encoder-h26x-annexb.https.any.html%3Fh265_annexb_software&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebcodecs%2Fvideo-encoder-h26x-annexb.https.any.html%3Fh265_annexb_hardware

TEXT DIFF:
*This is the most common diff for all
--- /Volumes/Data/worker/Apple-Sequoia-Release-AppleSilicon-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/webcodecs/video-encoder-h26x-annexb.https.any_h265_annexb_software-expected.txt
+++ /Volumes/Data/worker/Apple-Sequoia-Release-AppleSilicon-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/webcodecs/video-encoder-h26x-annexb.https.any_h265_annexb_software-actual.txt
@@ -1,3 +1,3 @@
 
-FAIL Verify stream compliance h26x annexb assert_equals: The frame is coded as Keyframe, but indicator does not match expected true but got false
+PASS Verify stream compliance h26x annexb
 

DIFF URL:
https://build.webkit.org/results/Apple-Sequoia-Release-AppleSilicon-WK2-Tests/297980@main%20(3913)/results.html

[Radar WebKit Bug Importer]

<rdar://problem/157027935>

[Bryan Medina]

I attempted to reproduce the text failure locally on my device running macOS Sequoia Release and Debug ToT using the following command:

run-webkit-tests <test_name_here> --iterations=1000

I was unable to reproduce the text failure locally.

[Bryan Medina]

Although I wasn't able to reproduce the failures, referring to the history, it seems as if the tests were failing since they were introduced/imported.

[EWS]

Test gardening commit 297994@main (ea50dad9be5b): <https://commits.webkit.org/297994@main>

Reviewed commits have been landed. Closing PR #48667 and removing active labels.