222808 2021-03-05 10:09:07 -0800 [ iOS/macOS wk2 ] imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https.html is a flakey text failure 2021-10-05 02:46:00 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified RESOLVED DUPLICATE 231223 InRadar P2 Normal --- 1 jenner webkit-unassigned webkit-bot-watchers-bugzilla webkit-bug-importer youennf oldest_to_newest 1736395 0 jenner 2021-03-05 10:09:07 -0800 imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https.html is flakey text failing HISTORY URL: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2Fprotocol%2Fcandidate-exchange.https.html DIFF TEXT: --- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https-expected.txt +++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https-actual.txt @@ -1,3 +1,5 @@ + +Harness Error (FAIL), message = Error: assert_unreached: [object RTCPeerConnectionIceEvent] Reached unreachable code PASS Two way ICE exchange works FAIL Adding only caller -> callee candidates gives a connection promise_test: Unhandled rejection with value: object "TypeError: undefined is not an object (evaluating 'pc1.sctp.transport')" 1736403 1 webkit-bug-importer 2021-03-05 10:21:38 -0800 <rdar://problem/75100612> 1736474 2 jenner 2021-03-05 12:16:19 -0800 To clarify the test is flakey text failing in iOS 14 and macOS Catalina+ on Release and Debug. Was able to reproduce the same failure at tip of tree on macOS BigSur using the test: run-webkit-test imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https.html --iterations 1000 -f The test has been flakey for a while, but it does not appear to have been occurring when the test was run in iOS 13 Simulator. The first reported text failure in the history was at r270315 on iOS 14 Debug Wk2 iPad (5th gen) simulator. The first reported text failure in history for Mac was at r270319 on Catalina E wk2 Debug. I was able to reproduce the failure on the oldest available spade as well, which is over 5000 revisions back from tip of tree. Since this appears to have been occurring for a while, I cannot deduce a regression point. 1736478 3 jenner 2021-03-05 12:26:20 -0800 Updated test expectations here: https://trac.webkit.org/changeset/273994/webkit 1800460 4 youennf 2021-10-05 02:46:00 -0700 *** This bug has been marked as a duplicate of bug 231223 ***