Bug 222808

Summary:	[ iOS/macOS wk2 ] imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https.html is a flakey text failure
Product:	WebKit	Reporter:	Robert Jenner <jenner>
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED DUPLICATE
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Robert Jenner 2021-03-05 10:09:07 PST

imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https.html

is flakey text failing 

HISTORY URL:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2Fprotocol%2Fcandidate-exchange.https.html

DIFF TEXT:
--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (FAIL), message = Error: assert_unreached: [object RTCPeerConnectionIceEvent] Reached unreachable code
 
 PASS Two way ICE exchange works
 FAIL Adding only caller -> callee candidates gives a connection promise_test: Unhandled rejection with value: object "TypeError: undefined is not an object (evaluating 'pc1.sctp.transport')"

Comment 1 Radar WebKit Bug Importer 2021-03-05 10:21:38 PST

<rdar://problem/75100612>

Comment 2 Robert Jenner 2021-03-05 12:16:19 PST

To clarify the test is flakey text failing in iOS 14 and macOS Catalina+ on Release and Debug. 

Was able to reproduce the same failure at tip of tree on macOS BigSur using the test:

run-webkit-test imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https.html --iterations 1000 -f

The test has been flakey for a while, but it does not appear to have been occurring when the test was run in iOS 13 Simulator. 

The first reported text failure in the history was at r270315 on iOS 14 Debug Wk2 iPad (5th gen) simulator.

The first reported text failure in history for Mac was at r270319 on Catalina E wk2 Debug. I was able to reproduce the failure on the oldest available spade as well, which is over 5000 revisions back from tip of tree. 

Since this appears to have been occurring for a while, I cannot deduce a regression point.

Comment 3 Robert Jenner 2021-03-05 12:26:20 PST

Updated test expectations here:

https://trac.webkit.org/changeset/273994/webkit

Comment 4 youenn fablet 2021-10-05 02:46:00 PDT


*** This bug has been marked as a duplicate of bug 231223 ***