Bug 231780

Summary:	[ iOS15 Mac wk2 Debug ] imported/w3c/web-platform-tests/webrtc/simulcast/basic.https.html is a flaky failure
Product:	WebKit	Reporter:	Eric Hutchison <ehutchison>
Component:	WebRTC	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED CONFIGURATION CHANGED
Severity:	Normal	CC:	ehutchison, hhjalmarsson, webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Eric Hutchison 2021-10-14 15:55:40 PDT

imported/w3c/web-platform-tests/webrtc/simulcast/basic.https.html

is a flaky failure on iOS15 and Mac Debug

History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2Fsimulcast%2Fbasic.https.html

Build: https://build.webkit.org/#/builders/267/builds/163

Results: https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/r284159%20(163)/results.html

Diff:
--- /Volumes/Data/worker/ios-simulator-15-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/simulcast/basic.https-expected.txt
+++ /Volumes/Data/worker/ios-simulator-15-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/simulcast/basic.https-actual.txt
@@ -1,3 +1,5 @@
 
-PASS Basic simulcast setup with two spatial layers
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Basic simulcast setup with two spatial layers Test timed out
+


Reproduced failure on ToT (r284093) using run-webkit-tests --debug --iterations 500 --exit-after-n-failures 1 --force --clobber-old-results --verbose imported/w3c/web-platform-tests/webrtc/simulcast/basic.https.html

Comment 1 Radar WebKit Bug Importer 2021-10-14 15:56:07 PDT

<rdar://problem/84278532>

Comment 2 Eric Hutchison 2021-10-14 16:07:50 PDT

Updated test expectations at https://trac.webkit.org/changeset/284211/webkit

Comment 3 Ryan Haddad 2022-05-19 14:19:18 PDT

This test appears to be consistently passing, let's remove the flaky expectation.

Comment 4 EWS 2022-07-05 15:08:10 PDT

Test gardening commit 252154@main (519c861e6564): <https://commits.webkit.org/252154@main>

Reviewed commits have been landed. Closing PR #2097 and removing active labels.

Comment 5 Hercules Hjalmarsson 2022-07-05 15:31:14 PDT

(In reply to EWS from comment #4)
> Test gardening commit 252154@main (519c861e6564):
> <https://commits.webkit.org/252154@main>
> 
> Reviewed commits have been landed. Closing PR #2097 and removing active
> labels.

Removed expectations in above commit.