Bug 313273 – [GStreamer] 3 new failures on MVT tests hls-hlsjs-test/HLS_FMP4_MP3 after 310634@main

• Status: RESOLVED
• Resolution: FIXED
• Component: New Bugs

[Carlos Alberto Lopez Perez]

310634@main caused around 29 new failures on the MVT tests run in the bot https://build.webkit.org/#/builders/WPE-Linux-64-bit-Release-MVT-Tests

Last good run: https://build.webkit.org/#/builders/1553/builds/7332
First bad run: https://build.webkit.org/#/builders/1553/builds/7333

However, another commit  in the range 311573@main-311565@main fixed all of those but 3

29 failures -> https://build.webkit.org/#/builders/1553/builds/7582
  3 failures -> https://build.webkit.org/#/builders/1553/builds/7583

Candidates for the fix:

$ git log --oneline e60220202a25de19758649614dd0611531782060..9d1f92e1a9caf9db069a66588c29f20ed4b95960 |grep -i gst
ab80d3c3e3f2 [GStreamer] Gardening https://bugs.webkit.org/show_bug.cgi?id=312760
2566042879a7 [GStreamer] Report support for supported non-AAC mp4a codecs https://bugs.webkit.org/show_bug.cgi?id=312501
ab6652549a6d REGRESSION(308531@main): [GStreamer][1.28] Flaky crashes when running test fast/mediastream/error.html https://bugs.webkit.org/show_bug.cgi?id=312157


The 3 failures that remain are this ones:

   - 3 tests were unexpected failures:
        HLS_FMP4_MP3__Playback
        HLS_FMP4_MP3__Pause
        HLS_FMP4_MP3__Seek


I have double checked locally that 310634@main introduced those by doing this:

1. checkout 310633@main, build wpe and run:
$ Tools/Scripts/run-mvt-tests --wpe --headless--release --suite hls-hlsjs-test

[Suite hls-hlsjs-test] Ran 38 tests, of which:
   - 38 tests passed.
   - 13 tests were unexpected passes:
        HLS_FMP4_AVC_EAC3__Playback
        HLS_CMAF_AVC_AAC__Playback
        HLS_CMAF_HEVC_EAC3__Playback
        HLS_FMP4_AVC_EAC3__Pause
        HLS_CMAF_AVC_AAC__Pause
        HLS_CMAF_HEVC_EAC3__Pause
        HLS_MP2TS_AVC_AAC__Seek
        HLS_FMP4_AVC_EAC3__Seek
        HLS_CMAF_AVC_AAC__Seek
        HLS_CMAF_HEVC_EAC3__Seek
        HLS_FMP4_AVC_EAC3__PlayRate
        HLS_CMAF_AVC_AAC__PlayRate
        HLS_CMAF_HEVC_EAC3__PlayRate


2. checkout 310634@main, build wpe and run:
$ Tools/Scripts/run-mvt-tests --wpe --headless --release --suite hls-hlsjs-test
[Suite hls-hlsjs-test] Ran 38 tests, of which:
   - 31 tests passed.
   - 13 tests were unexpected passes:
        HLS_FMP4_AVC_EAC3__Playback
        HLS_CMAF_AVC_AAC__Playback
        HLS_CMAF_HEVC_EAC3__Playback
        HLS_FMP4_AVC_EAC3__Pause
        HLS_CMAF_AVC_AAC__Pause
        HLS_CMAF_HEVC_EAC3__Pause
        HLS_MP2TS_AVC_AAC__Seek
        HLS_FMP4_AVC_EAC3__Seek
        HLS_CMAF_AVC_AAC__Seek
        HLS_CMAF_HEVC_EAC3__Seek
        HLS_FMP4_AVC_EAC3__PlayRate
        HLS_CMAF_AVC_AAC__PlayRate
        HLS_CMAF_HEVC_EAC3__PlayRate
   - 1 tests were expected failures:
        HLS_CMAF_AVC_MP3__Pause
   - 6 tests were unexpected failures:
        HLS_FMP4_MP3__Playback
        HLS_CMAF_AVC_MP3__Playback
        HLS_FMP4_MP3__Pause
        HLS_FMP4_MP3__Seek
        HLS_CMAF_AVC_MP3__Seek
        HLS_CMAF_AVC_MP3__PlayRate


So in that MVT suite 310634@main adds 6 failures, of those 3 still remain on main as of  311982@main

Run in main (311982@main):
$ Tools/Scripts/run-mvt-tests --wpe  --headless --release --suite hls-hlsjs-test
[Suite hls-hlsjs-test] Ran 38 tests, of which:
   - 35 tests passed.
   - 13 tests were unexpected passes:
        HLS_FMP4_AVC_EAC3__Playback
        HLS_CMAF_AVC_AAC__Playback
        HLS_CMAF_HEVC_EAC3__Playback
        HLS_FMP4_AVC_EAC3__Pause
        HLS_CMAF_AVC_AAC__Pause
        HLS_CMAF_HEVC_EAC3__Pause
        HLS_MP2TS_AVC_AAC__Seek
        HLS_FMP4_AVC_EAC3__Seek
        HLS_CMAF_AVC_AAC__Seek
        HLS_CMAF_HEVC_EAC3__Seek
        HLS_FMP4_AVC_EAC3__PlayRate
        HLS_CMAF_AVC_AAC__PlayRate
        HLS_CMAF_HEVC_EAC3__PlayRate
   - 3 tests were unexpected failures:
        HLS_FMP4_MP3__Playback
        HLS_FMP4_MP3__Pause
        HLS_FMP4_MP3__Seek

[Alicia Boya García]

Pull request: https://github.com/WebKit/WebKit/pull/63699

[EWS]

Committed 312190@main (056c4c55fb09): <https://commits.webkit.org/312190@main>

Reviewed commits have been landed. Closing PR #63699 and removing active labels.

[Radar WebKit Bug Importer]

<rdar://problem/175741589>

[EWS]

Committed 305877.490@webkitglib/2.52 (d5043a96b5d0): <https://commits.webkit.org/305877.490@webkitglib/2.52>

Reviewed commits have been landed. Closing PR #64750 and removing active labels.