Bug 216159 - REGRESSION(r266511): [ macOS iOS wk2 ] imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https.html is a flaky failure
Summary: REGRESSION(r266511): [ macOS iOS wk2 ] imported/w3c/web-platform-tests/webrt...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebRTC (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-09-03 17:34 PDT by Hector Lopez
Modified: 2021-05-11 09:52 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Hector Lopez 2020-09-03 17:34:41 PDT
imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https.html

Test is a flaky failure according to history on macOS wk2 and iOS wk2 Debug. First occurrence of failure is at r266511.

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-restartIce.https.html

Diff:
--- /Volumes/Data/slave/ipados-simulator-13-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-expected.txt
+++ /Volumes/Data/slave/ipados-simulator-13-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-actual.txt
@@ -1,5 +1,5 @@
 
-FAIL restartIce() does not trigger negotiation ahead of initial negotiation assert_equals: No negotiationneeded event expected (undefined) undefined but got (object) object "[object Event]"
+PASS restartIce() does not trigger negotiation ahead of initial negotiation 
 PASS restartIce() has no effect on initial negotiation 
 PASS restartIce() fires negotiationneeded after initial negotiation 
 PASS restartIce() causes fresh ufrags
Comment 1 Radar WebKit Bug Importer 2020-09-03 17:35:03 PDT
<rdar://problem/68312152>
Comment 2 Hector Lopez 2020-09-03 17:44:07 PDT
Test expectation while investigated:

https://trac.webkit.org
Comment 3 Ryan Haddad 2021-04-19 17:04:29 PDT
This test is now a consistent failure, so I don't know if it is still flaky:
--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-actual.txt
@@ -10,6 +10,6 @@
 PASS restartIce() survives remote offer
 PASS restartIce() is satisfied by remote ICE restart
 PASS restartIce() trumps {iceRestart: false}
-FAIL restartIce() survives rollback promise_test: Unhandled rejection with value: object "InvalidStateError: Description type incompatible with current signaling state"
+FAIL restartIce() survives rollback promise_test: Unhandled rejection with value: object "InvalidStateError: Local description type 3 is incompatible with current signaling state 1"
 FAIL restartIce() survives remote offer containing partial restart assert_false: Restarted 2 expected false got true
Comment 4 Ryan Haddad 2021-05-03 13:35:33 PDT
(In reply to Ryan Haddad from comment #3)
> This test is now a consistent failure, so I don't know if it is still flaky:
Rebaselined in https://trac.webkit.org/changeset/276922/webkit, will need to check on results in a day or two to see if the test is still flaky.
Comment 5 Ryan Haddad 2021-05-11 09:52:51 PDT
(In reply to Ryan Haddad from comment #4)
> (In reply to Ryan Haddad from comment #3)
> > This test is now a consistent failure, so I don't know if it is still flaky:
> Rebaselined in https://trac.webkit.org/changeset/276922/webkit, will need to
> check on results in a day or two to see if the test is still flaky.
Definitely still flaky.