216159 2020-09-03 17:34:41 -0700 REGRESSION(r266511): [ macOS iOS wk2 ] imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https.html is a flaky failure 2021-05-11 09:52:51 -0700 1 1 1 Unclassified WebKit WebRTC WebKit Nightly Build Unspecified Unspecified NEW InRadar P2 Normal --- 1 hector_i_lopez webkit-unassigned webkit-bot-watchers-bugzilla webkit-bug-importer youennf oldest_to_newest 1685512 0 hector_i_lopez 2020-09-03 17:34:41 -0700 imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https.html Test is a flaky failure according to history on macOS wk2 and iOS wk2 Debug. First occurrence of failure is at r266511. History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-restartIce.https.html Diff: --- /Volumes/Data/slave/ipados-simulator-13-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-expected.txt +++ /Volumes/Data/slave/ipados-simulator-13-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-actual.txt @@ -1,5 +1,5 @@ -FAIL restartIce() does not trigger negotiation ahead of initial negotiation assert_equals: No negotiationneeded event expected (undefined) undefined but got (object) object "[object Event]" +PASS restartIce() does not trigger negotiation ahead of initial negotiation PASS restartIce() has no effect on initial negotiation PASS restartIce() fires negotiationneeded after initial negotiation PASS restartIce() causes fresh ufrags 1685513 1 webkit-bug-importer 2020-09-03 17:35:03 -0700 <rdar://problem/68312152> 1685516 2 hector_i_lopez 2020-09-03 17:44:07 -0700 Test expectation while investigated: https://trac.webkit.org 1752056 3 ryanhaddad 2021-04-19 17:04:29 -0700 This test is now a consistent failure, so I don't know if it is still flaky: --- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-expected.txt +++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-actual.txt @@ -10,6 +10,6 @@ PASS restartIce() survives remote offer PASS restartIce() is satisfied by remote ICE restart PASS restartIce() trumps {iceRestart: false} -FAIL restartIce() survives rollback promise_test: Unhandled rejection with value: object "InvalidStateError: Description type incompatible with current signaling state" +FAIL restartIce() survives rollback promise_test: Unhandled rejection with value: object "InvalidStateError: Local description type 3 is incompatible with current signaling state 1" FAIL restartIce() survives remote offer containing partial restart assert_false: Restarted 2 expected false got true 1756305 4 ryanhaddad 2021-05-03 13:35:33 -0700 (In reply to Ryan Haddad from comment #3) > This test is now a consistent failure, so I don't know if it is still flaky: Rebaselined in https://trac.webkit.org/changeset/276922/webkit, will need to check on results in a day or two to see if the test is still flaky. 1758932 5 ryanhaddad 2021-05-11 09:52:51 -0700 (In reply to Ryan Haddad from comment #4) > (In reply to Ryan Haddad from comment #3) > > This test is now a consistent failure, so I don't know if it is still flaky: > Rebaselined in https://trac.webkit.org/changeset/276922/webkit, will need to > check on results in a day or two to see if the test is still flaky. Definitely still flaky.