Bug 230116 - [ MacOS ] imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel.html is a flaky failure
Summary: [ MacOS ] imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachan...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: youenn fablet
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-09-09 11:52 PDT by ayumi_kojima
Modified: 2022-03-14 05:06 PDT (History)
4 users (show)

See Also:


Attachments
Patch (1.68 KB, patch)
2022-03-14 03:58 PDT, youenn fablet
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description ayumi_kojima 2021-09-09 11:52:09 PDT
imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel.html

Is flaky failing on BigSur wk1 and Catalina wk1 & wk2.

It has been flaky on Catalina, but it started showing up on BigSur and failing more constantly at around r282006.

The flaky failure is seen on EWS as well.

The diff from more recent failure (BigSur) seems to be different from an older one (Catalina).

Diff (BigSur https://build.webkit.org/#/builders/101/builds/4521):

--- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt
+++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt
@@ -1,6 +1,8 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS offerer data channel in workers
-PASS answerer data channel in workers
-PASS data channel close event in worker
-PASS Failing to transfer a data channel
+TIMEOUT answerer data channel in workers Test timed out
+NOTRUN data channel close event in worker
+NOTRUN Failing to transfer a data channel
 

Diff (Catalina https://build.webkit.org/#/builders/36/builds/16038): 

--- /Volumes/Data/worker/catalina-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt
+++ /Volumes/Data/worker/catalina-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt
@@ -1,5 +1,5 @@
 
-PASS offerer data channel in workers
+FAIL offerer data channel in workers assert_equals: expected "OK" but got "opened"
 PASS answerer data channel in workers
 PASS data channel close event in worker
 PASS Failing to transfer a data channel
Comment 1 Radar WebKit Bug Importer 2021-09-09 11:52:33 PDT
<rdar://problem/82936812>
Comment 2 ayumi_kojima 2021-09-09 12:03:25 PDT
Marked expectations: https://trac.webkit.org/changeset/282232/webkit
Comment 4 ayumi_kojima 2021-09-09 14:25:33 PDT
I was not able to reproduce the failure locally (BigSur) using run-webkit-tests --iterations 1000 --clobber-old-results --exit-after-n-failures 1 imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel.html --force -1
Comment 5 ayumi_kojima 2021-09-09 14:27:26 PDT
I was able to reproduce the failure using -f argument.

Diff:

--- /Volumes/Data/Builds/GoldenGate/buildToTest/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt
+++ /Volumes/Data/Builds/GoldenGate/buildToTest/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt
@@ -1,5 +1,5 @@
 
-PASS offerer data channel in workers
+FAIL offerer data channel in workers assert_equals: expected "OK" but got "opened"
 PASS answerer data channel in workers
 PASS data channel close event in worker
 PASS Failing to transfer a data channel
Comment 6 ayumi_kojima 2021-09-09 14:52:45 PDT
The test failed at r278839 and r278830

Diff:

--- /Volumes/Data/Builds/GoldenGate/buildToTest/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt
+++ /Volumes/Data/Builds/GoldenGate/buildToTest/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt
@@ -1,5 +1,5 @@
 
-PASS offerer data channel in workers
+FAIL offerer data channel in workers assert_equals: expected "OK" but got "opened"
 PASS answerer data channel in workers
 PASS data channel close event in worker
 PASS Failing to transfer a data channel


The test also failed at the oldest spades available for BigSur (r268271)

Diff: 

--- /Volumes/Data/Builds/GoldenGate/test-268271/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt
+++ /Volumes/Data/Builds/GoldenGate/test-268271/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt
@@ -1,6 +1,8 @@
 
-PASS offerer data channel in workers
-PASS answerer data channel in workers
-PASS data channel close event in worker
-PASS Failing to transfer a data channel
+Harness Error (FAIL), message = Unhandled rejection: The object can not be cloned.
 
+TIMEOUT offerer data channel in workers Test timed out
+NOTRUN answerer data channel in workers
+NOTRUN data channel close event in worker
+NOTRUN Failing to transfer a data channel
+
Comment 7 ayumi_kojima 2021-09-13 09:28:52 PDT
I was not able to reproduce the failure on Catalina.
Comment 8 ayumi_kojima 2021-09-15 08:38:12 PDT
The test started failing constantly on the all platforms at https://trac.webkit.org/changeset/282445/webkit
Comment 9 Alexey Proskuryakov 2022-03-01 14:45:59 PST
Possibly fixed in bug 237327.
Comment 10 youenn fablet 2022-03-14 03:58:14 PDT
Created attachment 454575 [details]
Patch
Comment 11 EWS 2022-03-14 05:05:59 PDT
Committed r291223 (248378@main): <https://commits.webkit.org/248378@main>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 454575 [details].