172922 2017-06-05 09:19:06 -0700 LayoutTest webrtc/datachannel/basic.html is a flaky failure 2017-06-19 14:11:06 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified NEW https://bugs.webkit.org/show_bug.cgi?id=173480 InRadar P2 Normal --- 1 ryanhaddad webkit-unassigned jlewis3 webkit-bug-importer youennf oldest_to_newest 1315703 0 ryanhaddad 2017-06-05 09:19:06 -0700 LayoutTest webrtc/datachannel/basic.html is a flaky timeout https://build.webkit.org/results/Apple%20Sierra%20Release%20WK2%20(Tests)/r217779%20(1982)/results.html https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=webrtc%2Fdatachannel%2Fbasic.html 1315705 1 webkit-bug-importer 2017-06-05 09:21:03 -0700 <rdar://problem/32567235> 1317485 2 jlewis3 2017-06-09 10:41:01 -0700 I was able to reproduce the timeout on Sierra Release WK2 with: run-webkit-tests webrtc/datachannel/basic.html --no-retry-failure --iterations=100 1317494 3 jlewis3 2017-06-09 10:46:05 -0700 Original diff: --- /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/datachannel/basic-expected.txt +++ /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/datachannel/basic-actual.txt @@ -1,17 +1,5 @@ +#PID UNRESPONSIVE - com.apple.WebKit.WebContent.Development (pid 44243) +FAIL: Timed out waiting for notifyDone to be called -PASS Basic data channel exchange from offerer to receiver -PASS Basic data channel exchange from receiver to offerer -PASS Basic data channel exchange from offerer to receiver using UDP only -PASS Basic data channel exchange from offerer to receiver using TCP only -PASS Basic data channel exchange from offerer to receiver -PASS Creating data channel with very long label -PASS Creating data channel after closing the connection -PASS Wrong data channel init: long protocol -PASS Wrong data channel init: long id -PASS Wrong data channel init: maxPacketLifeTime and maxRetransmits -PASS Right data channel init: ordered init -PASS Right data channel init: unordered init -PASS Right data channel init: default ordered init with id -PASS Right data channel init: no init -PASS Right data channel init: null - +#EOF +#EOF Reproduced diff: --- /Users/~/buildtotest/layout-test-results/webrtc/datachannel/basic-expected.txt +++ /Users/~/buildtotest/layout-test-results/webrtc/datachannel/basic-actual.txt @@ -1,17 +1,5 @@ +#PID UNRESPONSIVE - com.apple.WebKit.WebContent.Development (pid 55885) +FAIL: Timed out waiting for notifyDone to be called -PASS Basic data channel exchange from offerer to receiver -PASS Basic data channel exchange from receiver to offerer -PASS Basic data channel exchange from offerer to receiver using UDP only -PASS Basic data channel exchange from offerer to receiver using TCP only -PASS Basic data channel exchange from offerer to receiver -PASS Creating data channel with very long label -PASS Creating data channel after closing the connection -PASS Wrong data channel init: long protocol -PASS Wrong data channel init: long id -PASS Wrong data channel init: maxPacketLifeTime and maxRetransmits -PASS Right data channel init: ordered init -PASS Right data channel init: unordered init -PASS Right data channel init: default ordered init with id -PASS Right data channel init: no init -PASS Right data channel init: null - +#EOF +#EOF 1319737 4 jlewis3 2017-06-15 15:08:51 -0700 Marked test as flaky: https://trac.webkit.org/changeset/218360/webkit 1320825 5 jlewis3 2017-06-19 14:06:30 -0700 This test has started to become flaky failures on Release builds after revision r218408 https://trac.webkit.org/changeset/218408/webkit https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r218500%20(2468)/results.html diff: --- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/webrtc/datachannel/basic-expected.txt +++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/webrtc/datachannel/basic-actual.txt @@ -1,6 +1,6 @@ -PASS Basic data channel exchange from offerer to receiver -PASS Basic data channel exchange from receiver to offerer -PASS Basic data channel exchange from offerer to receiver using UDP only -PASS Basic data channel exchange from offerer to receiver +FAIL Basic data channel exchange from offerer to receiver promise_test: Unhandled rejection with value: "Test timed out" +FAIL Basic data channel exchange from receiver to offerer promise_test: Unhandled rejection with value: "Test timed out" +FAIL Basic data channel exchange from offerer to receiver using UDP only promise_test: Unhandled rejection with value: "Test timed out" +FAIL Basic data channel exchange from offerer to receiver promise_test: Unhandled rejection with value: "Test timed out"