Bug 225525 - REGRESSION: [ BigSur+ ] various webrtc/video-* tests are flaky text failures due to unexpected logging
Summary: REGRESSION: [ BigSur+ ] various webrtc/video-* tests are flaky text failures ...
Status: RESOLVED CONFIGURATION CHANGED
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebRTC (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
: 227040 229521 (view as bug list)
Depends on:
Blocks:
 
Reported: 2021-05-07 11:20 PDT by Robert Jenner
Modified: 2024-03-15 09:00 PDT (History)
6 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2021-05-07 11:20:26 PDT 
webrtc/video-replace-muted-track.html

is a flaky text failure on BigSurE release wk2. 

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=webrtc%2Fvideo-replace-muted-track.html

TEXT DIFF:
-
+6.0/ 26.0  14348      -   -1/  -1 63.8    1/    0   1       0/    0  3 
 PASS Switching from disabled to enabled track

https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r277174%20(2405)/webrtc/video-replace-muted-track-pretty-diff.html
Comment 1 Robert Jenner 2021-05-07 14:37:25 PDT 
I was able to reproduce the failure at BigSurE Release Tot using the following test:

run-webkit-tests webrtc/video-replace-muted-track.html --iterations 1000 --child-process=1

This test appears to have become flaky with the BigSurE release, and doesn't seem to reproduce on older versions, or on Catalina.
Comment 2 Robert Jenner 2021-05-07 14:42:40 PDT 
Updated test expectations to Pass Failure here:

https://trac.webkit.org/changeset/277200/webkit
Comment 3 Radar WebKit Bug Importer 2021-05-07 14:43:18 PDT 
<rdar://problem/77674102>
Comment 4 Ryan Haddad 2021-06-28 13:58:56 PDT 
*** Bug 227040 has been marked as a duplicate of this bug. ***
Comment 5 Eric Hutchison 2021-08-16 16:48:57 PDT 
Logging issues also seen in Monterey.
Comment 6 youenn fablet 2021-08-20 09:16:20 PDT 

*** This bug has been marked as a duplicate of bug 229188 ***
Comment 7 youenn fablet 2021-08-20 09:16:43 PDT 
Still need to update test expectations...
Comment 8 Eric Hutchison 2021-09-17 15:36:30 PDT 
*** Bug 229521 has been marked as a duplicate of this bug. ***