Bug 172922 – LayoutTest webrtc/datachannel/basic.html is a flaky failure

• Component: New Bugs
• Status: NEW

[Ryan Haddad]

LayoutTest webrtc/datachannel/basic.html is a flaky timeout

https://build.webkit.org/results/Apple%20Sierra%20Release%20WK2%20(Tests)/r217779%20(1982)/results.html

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=webrtc%2Fdatachannel%2Fbasic.html

[Radar WebKit Bug Importer]

<rdar://problem/32567235>

[Matt Lewis]

I was able to reproduce the timeout on Sierra Release WK2 with:

run-webkit-tests webrtc/datachannel/basic.html --no-retry-failure --iterations=100

[Matt Lewis]

Original diff:
--- /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/datachannel/basic-expected.txt
+++ /Volumes/Data/slave/ios-simulator-10-release-tests-wk2/build/layout-test-results/webrtc/datachannel/basic-actual.txt
@@ -1,17 +1,5 @@
+#PID UNRESPONSIVE - com.apple.WebKit.WebContent.Development (pid 44243)
+FAIL: Timed out waiting for notifyDone to be called
 
-PASS Basic data channel exchange from offerer to receiver 
-PASS Basic data channel exchange from receiver to offerer 
-PASS Basic data channel exchange from offerer to receiver using UDP only 
-PASS Basic data channel exchange from offerer to receiver using TCP only 
-PASS Basic data channel exchange from offerer to receiver 
-PASS Creating data channel with very long label 
-PASS Creating data channel after closing the connection 
-PASS Wrong data channel init: long protocol 
-PASS Wrong data channel init: long id 
-PASS Wrong data channel init: maxPacketLifeTime and maxRetransmits 
-PASS Right data channel init: ordered init 
-PASS Right data channel init: unordered init 
-PASS Right data channel init: default ordered init with id 
-PASS Right data channel init: no init 
-PASS Right data channel init: null 
-
+#EOF
+#EOF


Reproduced diff:
--- /Users/~/buildtotest/layout-test-results/webrtc/datachannel/basic-expected.txt
+++ /Users/~/buildtotest/layout-test-results/webrtc/datachannel/basic-actual.txt
@@ -1,17 +1,5 @@
+#PID UNRESPONSIVE - com.apple.WebKit.WebContent.Development (pid 55885)
+FAIL: Timed out waiting for notifyDone to be called
 
-PASS Basic data channel exchange from offerer to receiver 
-PASS Basic data channel exchange from receiver to offerer 
-PASS Basic data channel exchange from offerer to receiver using UDP only 
-PASS Basic data channel exchange from offerer to receiver using TCP only 
-PASS Basic data channel exchange from offerer to receiver 
-PASS Creating data channel with very long label 
-PASS Creating data channel after closing the connection 
-PASS Wrong data channel init: long protocol 
-PASS Wrong data channel init: long id 
-PASS Wrong data channel init: maxPacketLifeTime and maxRetransmits 
-PASS Right data channel init: ordered init 
-PASS Right data channel init: unordered init 
-PASS Right data channel init: default ordered init with id 
-PASS Right data channel init: no init 
-PASS Right data channel init: null 
-
+#EOF
+#EOF

[Matt Lewis]

Marked test as flaky:
https://trac.webkit.org/changeset/218360/webkit

[Matt Lewis]

This test has started to become flaky failures on Release builds after revision r218408
https://trac.webkit.org/changeset/218408/webkit

https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r218500%20(2468)/results.html

diff:
--- /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/webrtc/datachannel/basic-expected.txt
+++ /Volumes/Data/slave/elcapitan-release-tests-wk2/build/layout-test-results/webrtc/datachannel/basic-actual.txt
@@ -1,6 +1,6 @@
 
-PASS Basic data channel exchange from offerer to receiver 
-PASS Basic data channel exchange from receiver to offerer 
-PASS Basic data channel exchange from offerer to receiver using UDP only 
-PASS Basic data channel exchange from offerer to receiver 
+FAIL Basic data channel exchange from offerer to receiver promise_test: Unhandled rejection with value: "Test timed out"
+FAIL Basic data channel exchange from receiver to offerer promise_test: Unhandled rejection with value: "Test timed out"
+FAIL Basic data channel exchange from offerer to receiver using UDP only promise_test: Unhandled rejection with value: "Test timed out"
+FAIL Basic data channel exchange from offerer to receiver promise_test: Unhandled rejection with value: "Test timed out"