LayoutTest webrtc/datachannel/basic.html is a flaky timeout https://build.webkit.org/results/Apple%20Sierra%20Release%20WK2%20(Tests)/r217779%20(1982)/results.html https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=webrtc%2Fdatachannel%2Fbasic.html
<rdar://problem/32567235>
I was able to reproduce the timeout on Sierra Release WK2 with: run-webkit-tests webrtc/datachannel/basic.html --no-retry-failure --iterations=100
Original diff: --- /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/datachannel/basic-expected.txt +++ /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/datachannel/basic-actual.txt @@ -1,17 +1,5 @@ +#PID UNRESPONSIVE - com.apple.WebKit.WebContent.Development (pid 44243) +FAIL: Timed out waiting for notifyDone to be called -PASS Basic data channel exchange from offerer to receiver -PASS Basic data channel exchange from receiver to offerer -PASS Basic data channel exchange from offerer to receiver using UDP only -PASS Basic data channel exchange from offerer to receiver using TCP only -PASS Basic data channel exchange from offerer to receiver -PASS Creating data channel with very long label -PASS Creating data channel after closing the connection -PASS Wrong data channel init: long protocol -PASS Wrong data channel init: long id -PASS Wrong data channel init: maxPacketLifeTime and maxRetransmits -PASS Right data channel init: ordered init -PASS Right data channel init: unordered init -PASS Right data channel init: default ordered init with id -PASS Right data channel init: no init -PASS Right data channel init: null - +#EOF +#EOF Reproduced diff: --- /Users/~/buildtotest/layout-test-results/webrtc/datachannel/basic-expected.txt +++ /Users/~/buildtotest/layout-test-results/webrtc/datachannel/basic-actual.txt @@ -1,17 +1,5 @@ +#PID UNRESPONSIVE - com.apple.WebKit.WebContent.Development (pid 55885) +FAIL: Timed out waiting for notifyDone to be called -PASS Basic data channel exchange from offerer to receiver -PASS Basic data channel exchange from receiver to offerer -PASS Basic data channel exchange from offerer to receiver using UDP only -PASS Basic data channel exchange from offerer to receiver using TCP only -PASS Basic data channel exchange from offerer to receiver -PASS Creating data channel with very long label -PASS Creating data channel after closing the connection -PASS Wrong data channel init: long protocol -PASS Wrong data channel init: long id -PASS Wrong data channel init: maxPacketLifeTime and maxRetransmits -PASS Right data channel init: ordered init -PASS Right data channel init: unordered init -PASS Right data channel init: default ordered init with id -PASS Right data channel init: no init -PASS Right data channel init: null - +#EOF +#EOF
Marked test as flaky: https://trac.webkit.org/changeset/218360/webkit
This test has started to become flaky failures on Release builds after revision r218408 https://trac.webkit.org/changeset/218408/webkit https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r218500%20(2468)/results.html diff: --- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/webrtc/datachannel/basic-expected.txt +++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/webrtc/datachannel/basic-actual.txt @@ -1,6 +1,6 @@ -PASS Basic data channel exchange from offerer to receiver -PASS Basic data channel exchange from receiver to offerer -PASS Basic data channel exchange from offerer to receiver using UDP only -PASS Basic data channel exchange from offerer to receiver +FAIL Basic data channel exchange from offerer to receiver promise_test: Unhandled rejection with value: "Test timed out" +FAIL Basic data channel exchange from receiver to offerer promise_test: Unhandled rejection with value: "Test timed out" +FAIL Basic data channel exchange from offerer to receiver using UDP only promise_test: Unhandled rejection with value: "Test timed out" +FAIL Basic data channel exchange from offerer to receiver promise_test: Unhandled rejection with value: "Test timed out"