Bug 225525

Summary: REGRESSION: [ BigSur+ ] various webrtc/video-* tests are flaky text failures due to unexpected logging
Product: WebKit Reporter: Robert Jenner <jenner>
Component: WebRTCAssignee: Nobody <webkit-unassigned>
Status: RESOLVED CONFIGURATION CHANGED    
Severity: Normal CC: amir_mark, ehutchison, eric.carlson, webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=225523
https://bugs.webkit.org/show_bug.cgi?id=227040
https://bugs.webkit.org/show_bug.cgi?id=229166
https://bugs.webkit.org/show_bug.cgi?id=229163
https://bugs.webkit.org/show_bug.cgi?id=229158
https://bugs.webkit.org/show_bug.cgi?id=229156
https://bugs.webkit.org/show_bug.cgi?id=226054

Description Robert Jenner 2021-05-07 11:20:26 PDT
webrtc/video-replace-muted-track.html

is a flaky text failure on BigSurE release wk2. 

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=webrtc%2Fvideo-replace-muted-track.html

TEXT DIFF:
-
+6.0/ 26.0  14348      -   -1/  -1 63.8    1/    0   1       0/    0  3 
 PASS Switching from disabled to enabled track

https://build.webkit.org/results/Apple-BigSur-Release-WK2-Tests/r277174%20(2405)/webrtc/video-replace-muted-track-pretty-diff.html
Comment 1 Robert Jenner 2021-05-07 14:37:25 PDT
I was able to reproduce the failure at BigSurE Release Tot using the following test:

run-webkit-tests webrtc/video-replace-muted-track.html --iterations 1000 --child-process=1

This test appears to have become flaky with the BigSurE release, and doesn't seem to reproduce on older versions, or on Catalina.
Comment 2 Robert Jenner 2021-05-07 14:42:40 PDT
Updated test expectations to Pass Failure here:

https://trac.webkit.org/changeset/277200/webkit
Comment 3 Radar WebKit Bug Importer 2021-05-07 14:43:18 PDT
<rdar://problem/77674102>
Comment 4 Ryan Haddad 2021-06-28 13:58:56 PDT
*** Bug 227040 has been marked as a duplicate of this bug. ***
Comment 5 Eric Hutchison 2021-08-16 16:48:57 PDT
Logging issues also seen in Monterey.
Comment 6 youenn fablet 2021-08-20 09:16:20 PDT

*** This bug has been marked as a duplicate of bug 229188 ***
Comment 7 youenn fablet 2021-08-20 09:16:43 PDT
Still need to update test expectations...
Comment 8 Eric Hutchison 2021-09-17 15:36:30 PDT
*** Bug 229521 has been marked as a duplicate of this bug. ***