230116 2021-09-09 11:52:09 -0700 [ MacOS ] imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel.html is a flaky failure 2022-03-14 05:06:04 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 ayumi_kojima youennf eric.carlson webkit-bot-watchers-bugzilla webkit-bug-importer youennf oldest_to_newest 1792013 0 ayumi_kojima 2021-09-09 11:52:09 -0700 imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel.html Is flaky failing on BigSur wk1 and Catalina wk1 & wk2. It has been flaky on Catalina, but it started showing up on BigSur and failing more constantly at around r282006. The flaky failure is seen on EWS as well. The diff from more recent failure (BigSur) seems to be different from an older one (Catalina). Diff (BigSur https://build.webkit.org/#/builders/101/builds/4521): --- /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt +++ /Volumes/Data/worker/bigsur-release-applesilicon-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt @@ -1,6 +1,8 @@ + +Harness Error (TIMEOUT), message = null PASS offerer data channel in workers -PASS answerer data channel in workers -PASS data channel close event in worker -PASS Failing to transfer a data channel +TIMEOUT answerer data channel in workers Test timed out +NOTRUN data channel close event in worker +NOTRUN Failing to transfer a data channel Diff (Catalina https://build.webkit.org/#/builders/36/builds/16038): --- /Volumes/Data/worker/catalina-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt +++ /Volumes/Data/worker/catalina-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt @@ -1,5 +1,5 @@ -PASS offerer data channel in workers +FAIL offerer data channel in workers assert_equals: expected "OK" but got "opened" PASS answerer data channel in workers PASS data channel close event in worker PASS Failing to transfer a data channel 1792014 1 webkit-bug-importer 2021-09-09 11:52:33 -0700 <rdar://problem/82936812> 1792017 2 ayumi_kojima 2021-09-09 12:03:25 -0700 Marked expectations: https://trac.webkit.org/changeset/282232/webkit 1792084 3 ayumi_kojima 2021-09-09 14:19:54 -0700 History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc-extensions%2Ftransfer-datachannel.html 1792087 4 ayumi_kojima 2021-09-09 14:25:33 -0700 I was not able to reproduce the failure locally (BigSur) using run-webkit-tests --iterations 1000 --clobber-old-results --exit-after-n-failures 1 imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel.html --force -1 1792088 5 ayumi_kojima 2021-09-09 14:27:26 -0700 I was able to reproduce the failure using -f argument. Diff: --- /Volumes/Data/Builds/GoldenGate/buildToTest/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt +++ /Volumes/Data/Builds/GoldenGate/buildToTest/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt @@ -1,5 +1,5 @@ -PASS offerer data channel in workers +FAIL offerer data channel in workers assert_equals: expected "OK" but got "opened" PASS answerer data channel in workers PASS data channel close event in worker PASS Failing to transfer a data channel 1792101 6 ayumi_kojima 2021-09-09 14:52:45 -0700 The test failed at r278839 and r278830 Diff: --- /Volumes/Data/Builds/GoldenGate/buildToTest/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt +++ /Volumes/Data/Builds/GoldenGate/buildToTest/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt @@ -1,5 +1,5 @@ -PASS offerer data channel in workers +FAIL offerer data channel in workers assert_equals: expected "OK" but got "opened" PASS answerer data channel in workers PASS data channel close event in worker PASS Failing to transfer a data channel The test also failed at the oldest spades available for BigSur (r268271) Diff: --- /Volumes/Data/Builds/GoldenGate/test-268271/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-expected.txt +++ /Volumes/Data/Builds/GoldenGate/test-268271/layout-test-results/imported/w3c/web-platform-tests/webrtc-extensions/transfer-datachannel-actual.txt @@ -1,6 +1,8 @@ -PASS offerer data channel in workers -PASS answerer data channel in workers -PASS data channel close event in worker -PASS Failing to transfer a data channel +Harness Error (FAIL), message = Unhandled rejection: The object can not be cloned. +TIMEOUT offerer data channel in workers Test timed out +NOTRUN answerer data channel in workers +NOTRUN data channel close event in worker +NOTRUN Failing to transfer a data channel + 1792975 7 ayumi_kojima 2021-09-13 09:28:52 -0700 I was not able to reproduce the failure on Catalina. 1793714 8 ayumi_kojima 2021-09-15 08:38:12 -0700 The test started failing constantly on the all platforms at https://trac.webkit.org/changeset/282445/webkit 1847200 9 ap 2022-03-01 14:45:59 -0800 Possibly fixed in bug 237327. 1850823 10 454575 youennf 2022-03-14 03:58:14 -0700 Created attachment 454575 Patch 1850837 11 ews-feeder 2022-03-14 05:05:59 -0700 Committed r291223 (248378@main): <https://commits.webkit.org/248378@main> All reviewed patches have been landed. Closing bug and clearing flags on attachment 454575. 454575 2022-03-14 03:58:14 -0700 2022-03-14 05:06:02 -0700 Patch bug-230116-20220314115812.patch text/plain 1723 youennf U3VidmVyc2lvbiBSZXZpc2lvbjogMjkxMjE2CmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggZjgzOTk3ZGM3M2UwNjFkODk1Y2U3 MDQxYjFiZGU0OTc1ODI4NDBiZi4uZTNhYTdkNjlkNDYxYzBhZDUxMGY2ODAwOTBkZjhiYWU0MjNl MWYxOSAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDE0IEBACisyMDIyLTAzLTE0ICBZb3Vlbm4gRmFibGV0ICA8 eW91ZW5uQGFwcGxlLmNvbT4KKworICAgICAgICBbIE1hY09TIF0gaW1wb3J0ZWQvdzNjL3dlYi1w bGF0Zm9ybS10ZXN0cy93ZWJydGMtZXh0ZW5zaW9ucy90cmFuc2Zlci1kYXRhY2hhbm5lbC5odG1s IGlzIGEgZmxha3kgZmFpbHVyZQorICAgICAgICBodHRwczovL2J1Z3Mud2Via2l0Lm9yZy9zaG93 X2J1Zy5jZ2k/aWQ9MjMwMTE2CisgICAgICAgIDxyZGFyOi8vcHJvYmxlbS84MjkzNjgxMj4KKwor ICAgICAgICBVbnJldmlld2VkLgorCisgICAgICAgICogcGxhdGZvcm0vbWFjL1Rlc3RFeHBlY3Rh dGlvbnM6CisgICAgICAgIFVuZmxha2UgdGVzdCBub3cgdGhhdCBpcyBwYXNzaW5nIGNvbnNpc3Rl bnRseSBvbiBib3RzLgorCiAyMDIyLTAzLTE0ICBZb3Vlbm4gRmFibGV0ICA8eW91ZW5uQGFwcGxl LmNvbT4KIAogICAgICAgICBbIEJpZ1N1ciB3azIgYXJtNjQgXSA0IHdlYnJ0Yy8gTGF5b3V0LXRl c3RzIGFyZSBjb25zaXN0ZW50bHkgdGltaW5nIG91dApkaWZmIC0tZ2l0IGEvTGF5b3V0VGVzdHMv cGxhdGZvcm0vbWFjL1Rlc3RFeHBlY3RhdGlvbnMgYi9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9tYWMv VGVzdEV4cGVjdGF0aW9ucwppbmRleCBlZWQ5NDkxYmJiMTFlNmQ5YzRlMWNkMzhhZWY2NTg1OWUx ZWNlYzcxLi4zNmNmODUxYjQ1OWU1NzM3ZTg1ZGY3NGQ2MzhiYjkwNThlN2VmMTgxIDEwMDY0NAot LS0gYS9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9tYWMvVGVzdEV4cGVjdGF0aW9ucworKysgYi9MYXlv dXRUZXN0cy9wbGF0Zm9ybS9tYWMvVGVzdEV4cGVjdGF0aW9ucwpAQCAtMjI3MCw4ICsyMjcwLDYg QEAgd2Via2l0Lm9yZy9iLzIyODY0MiBpbXBvcnRlZC93M2Mvd2ViLXBsYXRmb3JtLXRlc3RzL2h0 bWwvY3Jvc3Mtb3JpZ2luLW9wZW5lci1wb2wKIHdlYmtpdC5vcmcvYi8yMjk1MTcgaW1wb3J0ZWQv dzNjL3dlYi1wbGF0Zm9ybS10ZXN0cy93ZWJydGMtZXh0ZW5zaW9ucy9SVENSdHBTeW5jaHJvbml6 YXRpb25Tb3VyY2UtY2FwdHVyZVRpbWVzdGFtcC5odG1sIFsgUGFzcyBGYWlsdXJlIF0KIHdlYmtp dC5vcmcvYi8yMjk1MTcgaW1wb3J0ZWQvdzNjL3dlYi1wbGF0Zm9ybS10ZXN0cy93ZWJydGMtZXh0 ZW5zaW9ucy9SVENSdHBTeW5jaHJvbml6YXRpb25Tb3VyY2Utc2VuZGVyQ2FwdHVyZVRpbWVPZmZz ZXQuaHRtbCBbIFBhc3MgRmFpbHVyZSBdCiAKLXdlYmtpdC5vcmcvYi8yMzAxMTYgaW1wb3J0ZWQv dzNjL3dlYi1wbGF0Zm9ybS10ZXN0cy93ZWJydGMtZXh0ZW5zaW9ucy90cmFuc2Zlci1kYXRhY2hh bm5lbC5odG1sIFsgUGFzcyBGYWlsdXJlIF0KLQogIyBhY2NlbnQtY29sb3IgaXMgY3VycmVudGx5 IG9ubHkgc3VwcG9ydGVkIG9uIENvY29hIHBsYXRmb3JtcwogZmFzdC9jc3MvYWNjZW50LWNvbG9y L2NoZWNrYm94Lmh0bWwgWyBQYXNzIF0KIGZhc3QvY3NzL2FjY2VudC1jb2xvci9wcm9ncmVzcy5o dG1sIFsgUGFzcyBdCg==