Bug 216159 – REGRESSION(r266511): [ macOS iOS wk2 ] imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https.html is a flaky failure

• Component: WebRTC
• Status: NEW

[Hector Lopez]

imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https.html

Test is a flaky failure according to history on macOS wk2 and iOS wk2 Debug. First occurrence of failure is at r266511.

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-restartIce.https.html

Diff:
--- /Volumes/Data/slave/ipados-simulator-13-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-expected.txt
+++ /Volumes/Data/slave/ipados-simulator-13-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-actual.txt
@@ -1,5 +1,5 @@
 
-FAIL restartIce() does not trigger negotiation ahead of initial negotiation assert_equals: No negotiationneeded event expected (undefined) undefined but got (object) object "[object Event]"
+PASS restartIce() does not trigger negotiation ahead of initial negotiation 
 PASS restartIce() has no effect on initial negotiation 
 PASS restartIce() fires negotiationneeded after initial negotiation 
 PASS restartIce() causes fresh ufrags

[Radar WebKit Bug Importer]

<rdar://problem/68312152>

[Hector Lopez]

Test expectation while investigated:

https://trac.webkit.org

[Ryan Haddad]

This test is now a consistent failure, so I don't know if it is still flaky:
--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-actual.txt
@@ -10,6 +10,6 @@
 PASS restartIce() survives remote offer
 PASS restartIce() is satisfied by remote ICE restart
 PASS restartIce() trumps {iceRestart: false}
-FAIL restartIce() survives rollback promise_test: Unhandled rejection with value: object "InvalidStateError: Description type incompatible with current signaling state"
+FAIL restartIce() survives rollback promise_test: Unhandled rejection with value: object "InvalidStateError: Local description type 3 is incompatible with current signaling state 1"
 FAIL restartIce() survives remote offer containing partial restart assert_false: Restarted 2 expected false got true

[Ryan Haddad]

(In reply to Ryan Haddad from comment #3)
> This test is now a consistent failure, so I don't know if it is still flaky:
Rebaselined in https://trac.webkit.org/changeset/276922/webkit, will need to check on results in a day or two to see if the test is still flaky.

[Ryan Haddad]

(In reply to Ryan Haddad from comment #4)
> (In reply to Ryan Haddad from comment #3)
> > This test is now a consistent failure, so I don't know if it is still flaky:
> Rebaselined in https://trac.webkit.org/changeset/276922/webkit, will need to
> check on results in a day or two to see if the test is still flaky.
Definitely still flaky.