Bug 230116 – [ MacOS ] imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel.html is a flaky failure

• Component: New Bugs
• Status: RESOLVED FIXED

imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel.html

Is flaky failing on BigSur wk1 and Catalina wk1 & wk2.

It has been flaky on Catalina, but it started showing up on BigSur and failing more constantly at around r282006.

The flaky failure is seen on EWS as well.

The diff from more recent failure (BigSur) seems to be different from an older one (Catalina).

Diff (BigSur https://build.webkit.org/#/builders/101/builds/4521):

--- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt
+++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt
@@ -1,6 +1,8 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS offerer data channel in workers
-PASS answerer data channel in workers
-PASS data channel close event in worker
-PASS Failing to transfer a data channel
+TIMEOUT answerer data channel in workers Test timed out
+NOTRUN data channel close event in worker
+NOTRUN Failing to transfer a data channel
 

Diff (Catalina https://build.webkit.org/#/builders/36/builds/16038): 

--- /Volumes/Data/worker/catalina-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt
+++ /Volumes/Data/worker/catalina-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt
@@ -1,5 +1,5 @@
 
-PASS offerer data channel in workers
+FAIL offerer data channel in workers assert_equals: expected "OK" but got "opened"
 PASS answerer data channel in workers
 PASS data channel close event in worker
 PASS Failing to transfer a data channel

[Radar WebKit Bug Importer]

<rdar://problem/82936812>

Marked expectations: https://trac.webkit.org/changeset/282232/webkit

History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc-extensions%2Ftransfer-datachannel.html

I was not able to reproduce the failure locally (BigSur) using run-webkit-tests --iterations 1000 --clobber-old-results --exit-after-n-failures 1 imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel.html --force -1

I was able to reproduce the failure using -f argument.

Diff:

--- /Volumes/Data/Builds/GoldenGate/buildToTest/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt
+++ /Volumes/Data/Builds/GoldenGate/buildToTest/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt
@@ -1,5 +1,5 @@
 
-PASS offerer data channel in workers
+FAIL offerer data channel in workers assert_equals: expected "OK" but got "opened"
 PASS answerer data channel in workers
 PASS data channel close event in worker
 PASS Failing to transfer a data channel

The test failed at r278839 and r278830

Diff:

--- /Volumes/Data/Builds/GoldenGate/buildToTest/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt
+++ /Volumes/Data/Builds/GoldenGate/buildToTest/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt
@@ -1,5 +1,5 @@
 
-PASS offerer data channel in workers
+FAIL offerer data channel in workers assert_equals: expected "OK" but got "opened"
 PASS answerer data channel in workers
 PASS data channel close event in worker
 PASS Failing to transfer a data channel


The test also failed at the oldest spades available for BigSur (r268271)

Diff: 

--- /Volumes/Data/Builds/GoldenGate/test-268271/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt
+++ /Volumes/Data/Builds/GoldenGate/test-268271/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt
@@ -1,6 +1,8 @@
 
-PASS offerer data channel in workers
-PASS answerer data channel in workers
-PASS data channel close event in worker
-PASS Failing to transfer a data channel
+Harness Error (FAIL), message = Unhandled rejection: The object can not be cloned.
 
+TIMEOUT offerer data channel in workers Test timed out
+NOTRUN answerer data channel in workers
+NOTRUN data channel close event in worker
+NOTRUN Failing to transfer a data channel
+

I was not able to reproduce the failure on Catalina.

The test started failing constantly on the all platforms at https://trac.webkit.org/changeset/282445/webkit

[Alexey Proskuryakov]

Possibly fixed in bug 237327.

[youenn fablet]

Created attachment 454575 [details]
Patch

[EWS]

Committed r291223 (248378@main): <https://commits.webkit.org/248378@main>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 454575 [details].