Bug 223043 – [ BigSur wk2 arm64 ] 4 webrtc/ Layout-tests are consistently timing out

• Status: RESOLVED
• Resolution: FIXED
• Component: WebRTC

[Robert Jenner]

The following four tests are consistently timing out on BigSur wk2 on Apple Silicon machines:
webrtc/h264-high.html
webrtc/multi-audio.html
webrtc/multi-video.html
webrtc/vp9-profile2.html


History URL:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=webrtc%2Fh264-high.html&test=webrtc%2Fmulti-audio.html&test=webrtc%2Fmulti-video.html&test=webrtc%2Fvp9-profile2.html&platform=mac

It should be noted that the following two have failed consistently since they started running on Apple Silicon:
webrtc/h264-high.html
webrtc/vp9-profile2.html

Whereas the other two below were flakey timing out since they started running on Apple Silicon, and become a constant timeout at r274156: 
webrtc/multi-audio.html
webrtc/multi-video.html

[Radar WebKit Bug Importer]

<rdar://problem/75280718>

[Robert Jenner]

Created attachment 422867 [details]
A file with all four diffs showing the timeouts.

I'm attaching all four diffs to this bug. Other than showing the timeout, I'm not certain how helpful they will be.

[Robert Jenner]

I cannot reproduce these timeouts because I do not have access to an Apple Silicon system.

[Robert Jenner]

While we are deciding on a fix for these tests, I have updated the test expectations for them and a few other webrtc tests that are having issues only on Apple Silicon Macs.

https://trac.webkit.org/changeset/274484/webkit

[Robert Jenner]

One test started timing out constantly when marked as Failure. So I updated the test expectations to include Failure Timeout here:
https://trac.webkit.org/changeset/274514/webkit

[Robert Jenner]

Added crash expectation to "webrtc/multi-audio.html" while test is under review:

https://trac.webkit.org/changeset/275851/webkit

webrtc/multi-audio.html 

Seems like this test is now flaky failing on BigSur

Created attachment 432555 [details]
Patch

Created attachment 432557 [details]
Patch

[Truitt Savell]

Comment on attachment 432557 [details]
Patch

Clearing flags on attachment: 432557

Committed r279396 (239261@main): <https://commits.webkit.org/239261@main>

[youenn fablet]

Created attachment 454573 [details]
Patch

[youenn fablet]

Created attachment 454574 [details]
Patch

[EWS]

Committed r291221 (248376@main): <https://commits.webkit.org/248376@main>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 454574 [details].

[Ryan Haddad]

webrtc/vp9-profile2.html is still a consistent timeout on arm64 bots after it was un-skipped: https://results.webkit.org/?suite=layout-tests&test=webrtc/vp9-profile2.html

[Ben Schwartz]

This no longer appears to be occurring. Removing test expectations. Please file a new bug if issues persist.

Tracking test expectations removal in bug #274990 (rdar://129080660).