Bug 222808 - [ iOS/macOS wk2 ] imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https.html is a flakey text failure
Summary: [ iOS/macOS wk2 ] imported/w3c/web-platform-tests/webrtc/protocol/candidate-e...
Status: RESOLVED DUPLICATE of bug 231223
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-03-05 10:09 PST by Robert Jenner
Modified: 2021-10-05 02:46 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2021-03-05 10:09:07 PST
imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https.html

is flakey text failing 

HISTORY URL:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2Fprotocol%2Fcandidate-exchange.https.html

DIFF TEXT:
--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (FAIL), message = Error: assert_unreached: [object RTCPeerConnectionIceEvent] Reached unreachable code
 
 PASS Two way ICE exchange works
 FAIL Adding only caller -> callee candidates gives a connection promise_test: Unhandled rejection with value: object "TypeError: undefined is not an object (evaluating 'pc1.sctp.transport')"
Comment 1 Radar WebKit Bug Importer 2021-03-05 10:21:38 PST
<rdar://problem/75100612>
Comment 2 Robert Jenner 2021-03-05 12:16:19 PST
To clarify the test is flakey text failing in iOS 14 and macOS Catalina+ on Release and Debug. 

Was able to reproduce the same failure at tip of tree on macOS BigSur using the test:

run-webkit-test imported/w3c/web-platform-tests/webrtc/protocol/candidate-exchange.https.html --iterations 1000 -f

The test has been flakey for a while, but it does not appear to have been occurring when the test was run in iOS 13 Simulator. 

The first reported text failure in the history was at r270315 on iOS 14 Debug Wk2 iPad (5th gen) simulator.

The first reported text failure in history for Mac was at r270319 on Catalina E wk2 Debug. I was able to reproduce the failure on the oldest available spade as well, which is over 5000 revisions back from tip of tree. 

Since this appears to have been occurring for a while, I cannot deduce a regression point.
Comment 3 Robert Jenner 2021-03-05 12:26:20 PST
Updated test expectations here:

https://trac.webkit.org/changeset/273994/webkit
Comment 4 youenn fablet 2021-10-05 02:46:00 PDT

*** This bug has been marked as a duplicate of bug 231223 ***