206503 2020-01-20 08:19:49 -0800 imported/w3c/web-platform-tests/html/dom/idlharness.worker.html is timing out on Catalina wk1 debug EWS 2021-10-03 22:06:13 -0700 1 1 1 Unclassified WebKit Tools / Tests Other Unspecified Unspecified NEW https://bugs.webkit.org/show_bug.cgi?id=206073 https://bugs.webkit.org/show_bug.cgi?id=231030 InRadar P2 Normal --- 1 aakash_jain webkit-unassigned ap jenner ryanhaddad tsavell webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1608777 0 aakash_jain 2020-01-20 08:19:49 -0800 imported/w3c/web-platform-tests/html/dom/idlharness.worker.html is failing on Mojave wk1 debug EWS. This is slowing down mac-wk1-debug EWS since EWS has to re-run the test to rule out flakiness and then run tests on clean tree to check if the failure is pre-existing. e.g.: https://ews-build.webkit.org/#/builders/32/builds/1017 https://ews-build.webkit.org/#/builders/32/builds/1013 https://ews-build.webkit.org/#/builders/32/builds/1011 https://ews-build.webkit.org/#/builders/32/builds/997 https://ews-build.webkit.org/#/builders/32/builds/991 https://ews-build.webkit.org/#/builders/32/builds/980 1608778 1 aakash_jain 2020-01-20 08:20:38 -0800 https://ews-build.webkit.org/results/macOS-Mojave-Debug-WK1-Tests-EWS/r388229-1017/results.html --- /Volumes/Data/worker/macOS-Mojave-Debug-WK1-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/dom/idlharness.worker-expected.txt +++ /Volumes/Data/worker/macOS-Mojave-Debug-WK1-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/dom/idlharness.worker-actual.txt @@ -1,5 +1,7 @@ -PASS idl_test setup +Harness Error (TIMEOUT), message = null + +TIMEOUT idl_test setup Test timed out PASS idl_test validation PASS Partial interface Document: original interface defined PASS Partial interface Document: member names are unique @@ -76,717 +78,5 @@ PASS Partial interface Window: original interface defined PASS Partial interface Window: member names are unique PASS Partial interface UIEvent: member names are unique -PASS Document includes GlobalEventHandlers: member names are unique -PASS Document includes DocumentAndElementEventHandlers: member names are unique -PASS Document includes NonElementParentNode: member names are unique ... ... ... -PASS MouseEvent interface: existence and properties of interface object +TIMEOUT Document includes GlobalEventHandlers: member names are unique Test timed out 1608779 2 aakash_jain 2020-01-20 08:23:08 -0800 Doesn't seems to happen on build.webkit.org https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fdom%2Fidlharness.worker.html 1609332 3 ryanhaddad 2020-01-21 15:33:55 -0800 Marked the test as failing to speed up EWS while we investigate in https://trac.webkit.org/changeset/254888/webkit 1609753 4 ap 2020-01-22 14:34:41 -0800 The test is very slow, easily taking 10-20 seconds in post-commit debug. So it's not very surprising that it's a flaky timeout on machines with more cores. > Marked the test as failing to speed up EWS while we investigate in https://trac.webkit.org/changeset/254888/webkit It seems like it doesn't need to be marked on release. 1612710 5 webkit-bug-importer 2020-01-29 15:02:03 -0800 <rdar://problem/59008330> 1612785 6 ryanhaddad 2020-01-29 17:37:09 -0800 (In reply to Alexey Proskuryakov from comment #4) > It seems like it doesn't need to be marked on release. Limited it to debug in https://trac.webkit.org/changeset/255408/webkit 1725170 7 ryanhaddad 2021-02-03 09:14:51 -0800 Still seeing flakiness after migrating EWS to Catalina: https://ews-build.s3-us-west-2.amazonaws.com/macOS-Catalina-Debug-WK1-Tests-EWS/r419103-338/results.html --- /Volumes/Data/worker/macOS-Catalina-Debug-WK1-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/dom/idlharness.worker-expected.txt +++ /Volumes/Data/worker/macOS-Catalina-Debug-WK1-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/html/dom/idlharness.worker-actual.txt @@ -1,4 +1,6 @@ Blocked access to external URL http://invalid/ + +Harness Error (TIMEOUT), message = null PASS idl_test setup PASS idl_test validation 1728672 8 420150 jenner 2021-02-12 11:05:34 -0800 Created attachment 420150 Update TestExpectations 1728820 9 420150 ryanhaddad 2021-02-12 15:29:20 -0800 Comment on attachment 420150 Update TestExpectations Clearing flags on attachment: 420150 Committed r272817 (234053@main): <https://commits.webkit.org/234053@main> 420150 2021-02-12 11:05:34 -0800 2021-02-12 15:29:41 -0800 Update TestExpectations bug-206503-20210212110533.patch text/plain 1741 jenner U3VidmVyc2lvbiBSZXZpc2lvbjogMjcyNzg5CmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggNjYzMTczMThhZjk3ZGZjMzdkN2I4 NTE4MjJhYTUxNGVhNzg0YTU1Yi4uM2MzMWNiMzFhZGVmMjY1YjA3MzdkMTY3MzliYmMzZTgzMjVk ZmY3NyAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDExIEBACisKKyAgICAgICAgaW1wb3J0ZWQvdzNjL3dlYi1w bGF0Zm9ybS10ZXN0cy9odG1sL2RvbS9pZGxoYXJuZXNzLndvcmtlci5odG1sIGlzIHRpbWluZyBv dXQgb24gQ2F0YWxpbmEgd2sxIGRlYnVnIEVXUworICAgICAgICBodHRwczovL2J1Z3Mud2Via2l0 Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9MjA2NTAzCisKKyAgICAgICAgVW5yZXZpZXdlZCB0ZXN0IGdh cmRlbmluZy4gCisKKyAgICAgICAgKiBwbGF0Zm9ybS9tYWMtd2sxL1Rlc3RFeHBlY3RhdGlvbnM6 IENoYW5nZWQgZXhwZWN0YXRpb24gZnJvbSBNb2phdmUgdG8gQ2F0YWxpbmEgdG8gc3VwcHJlc3Mg ZmFpbHVyZS4KKwogMjAyMS0wMi0xMiAgUm9iZXJ0IEplbm5lciAgPGplbm5lckBhcHBsZS5jb20+ CiAKICAgICAgICAgWyBtYWNPUyB3azIgXSB3ZWJncHUvd2hsc2wvZG8td2hpbGUtbG9vcC1icmVh ay5odG1sIGlzIGEgZmxha3kgZmFpbHVyZQpkaWZmIC0tZ2l0IGEvTGF5b3V0VGVzdHMvcGxhdGZv cm0vbWFjLXdrMS9UZXN0RXhwZWN0YXRpb25zIGIvTGF5b3V0VGVzdHMvcGxhdGZvcm0vbWFjLXdr MS9UZXN0RXhwZWN0YXRpb25zCmluZGV4IGUwY2JjNGMzYzczMTViMThmZmM3NzJlM2I0YzU0ZjUz Mjk0MGUwYTUuLmE3ODM2ZDA3NWFkNDVjYTc2ZjlkMTk4YjQxYjI5Njg5Njk4NDYxMTMgMTAwNjQ0 Ci0tLSBhL0xheW91dFRlc3RzL3BsYXRmb3JtL21hYy13azEvVGVzdEV4cGVjdGF0aW9ucworKysg Yi9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9tYWMtd2sxL1Rlc3RFeHBlY3RhdGlvbnMKQEAgLTEwOTEs NyArMTA5MSw3IEBAIHdlYmtpdC5vcmcvYi8yMDYxNzggWyBNb2phdmUgXSBlZGl0aW5nL3NwZWxs aW5nL3NwZWxsY2hlY2stYXR0cmlidXRlLmh0bWwgWyBQYXNzCiB3ZWJraXQub3JnL2IvMTkwMzUw IFsgTW9qYXZlIF0gc3RvcmFnZS9pbmRleGVkZGIvZGF0YWJhc2Utb2RkLW5hbWVzLmh0bWwgWyBG YWlsdXJlIF0KIFsgTW9qYXZlIF0gZWRpdGluZy9tYWMvaW5wdXQvZmlyc3RyZWN0Zm9yY2hhcmFj dGVycmFuZ2Utc3R5bGVkLmh0bWwgWyBGYWlsdXJlIF0KIAotd2Via2l0Lm9yZy9iLzIwNjUwMyBb IE1vamF2ZSBEZWJ1ZyBdIGltcG9ydGVkL3czYy93ZWItcGxhdGZvcm0tdGVzdHMvaHRtbC9kb20v aWRsaGFybmVzcy53b3JrZXIuaHRtbCBbIEZhaWx1cmUgXQord2Via2l0Lm9yZy9iLzIwNjUwMyBb IENhdGFsaW5hIERlYnVnIF0gaW1wb3J0ZWQvdzNjL3dlYi1wbGF0Zm9ybS10ZXN0cy9odG1sL2Rv bS9pZGxoYXJuZXNzLndvcmtlci5odG1sIFsgRmFpbHVyZSBdCiB3ZWJraXQub3JnL2IvMjA1NDEy IFsgTW9qYXZlIERlYnVnIF0gd2ViZ2wvMS4wLjMvY29uZm9ybWFuY2UvcmVuZGVyaW5nL21hbnkt ZHJhdy1jYWxscy5odG1sIFsgVGltZW91dCBdCiAKIHdlYmtpdC5vcmcvYi8yMTI4NTEgWyBNb2ph dmUgUmVsZWFzZSBdIGpzL2RvbS91bmhhbmRsZWQtcHJvbWlzZS1yZWplY3Rpb24tY29uc29sZS1u by1yZXBvcnQuaHRtbCBbIFBhc3MgRmFpbHVyZSBdCg==