imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https.html Test is a flaky failure according to history on macOS wk2 and iOS wk2 Debug. First occurrence of failure is at r266511. History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-restartIce.https.html Diff: --- /Volumes/Data/slave/ipados-simulator-13-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-expected.txt +++ /Volumes/Data/slave/ipados-simulator-13-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-actual.txt @@ -1,5 +1,5 @@ -FAIL restartIce() does not trigger negotiation ahead of initial negotiation assert_equals: No negotiationneeded event expected (undefined) undefined but got (object) object "[object Event]" +PASS restartIce() does not trigger negotiation ahead of initial negotiation PASS restartIce() has no effect on initial negotiation PASS restartIce() fires negotiationneeded after initial negotiation PASS restartIce() causes fresh ufrags
<rdar://problem/68312152>
Test expectation while investigated: https://trac.webkit.org
This test is now a consistent failure, so I don't know if it is still flaky: --- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-expected.txt +++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-actual.txt @@ -10,6 +10,6 @@ PASS restartIce() survives remote offer PASS restartIce() is satisfied by remote ICE restart PASS restartIce() trumps {iceRestart: false} -FAIL restartIce() survives rollback promise_test: Unhandled rejection with value: object "InvalidStateError: Description type incompatible with current signaling state" +FAIL restartIce() survives rollback promise_test: Unhandled rejection with value: object "InvalidStateError: Local description type 3 is incompatible with current signaling state 1" FAIL restartIce() survives remote offer containing partial restart assert_false: Restarted 2 expected false got true
(In reply to Ryan Haddad from comment #3) > This test is now a consistent failure, so I don't know if it is still flaky: Rebaselined in https://trac.webkit.org/changeset/276922/webkit, will need to check on results in a day or two to see if the test is still flaky.
(In reply to Ryan Haddad from comment #4) > (In reply to Ryan Haddad from comment #3) > > This test is now a consistent failure, so I don't know if it is still flaky: > Rebaselined in https://trac.webkit.org/changeset/276922/webkit, will need to > check on results in a day or two to see if the test is still flaky. Definitely still flaky.