229459 2021-08-24 11:35:53 -0700 [ EWS Catalina ] http/tests/websocket/tests/hybi/inspector/send-and-recieve-debugger.html is flaky timing out / failing 2021-08-26 14:59:30 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Mac (Intel) Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 ayumi_kojima pangle ews-watchlist hi pangle rniwa webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1786852 0 ayumi_kojima 2021-08-24 11:35:53 -0700 http/tests/websocket/tests/hybi/inspector/send-and-recieve-debugger.html Is flaky timing out on macOS-Catalina-Debug-WK1-Tests-EWS The flaky timeout and failure is seen on Big Sur wk1 Debug and Catalina Debug in the open source directory: https://results.webkit.org/?suite=layout-tests&test=http/tests/websocket/tests/hybi/inspector/send-and-recieve-debugger.html Result page: https://ews-build.s3-us-west-2.amazonaws.com/macOS-Catalina-Debug-WK1-Tests-EWS/r436009-13490/results.html Flakiness on EWS seems to have started at this build https://ews-build.webkit.org/#/builders/56/builds/13490 Diff from timeout and failure on the open source: --- /Volumes/Data/worker/catalina-debug-tests-wk1/build/layout-test-results/http/tests/websocket/tests/hybi/inspector/send-and-recieve-debugger-expected.txt +++ /Volumes/Data/worker/catalina-debug-tests-wk1/build/layout-test-results/http/tests/websocket/tests/hybi/inspector/send-and-recieve-debugger-actual.txt @@ -1,3 +1,4 @@ +FAIL: Timed out waiting for notifyDone to be called Tests sending and receiving WebSocket messages. @@ -9,10 +10,10 @@ PASS: Frame should be outgoing. PASS: Message is walltime. Pausing script execution with `debugger` statement. -Resuming script execution. PASS: Resource size should double. PASS: Frame data should be 'Hello World! Привет Мир!' PASS: Frame should be text. PASS: Frame should be incoming. PASS: Frame walltime should be greater than the previous one. +Resuming script execution. 1786853 1 webkit-bug-importer 2021-08-24 11:36:16 -0700 <rdar://problem/82301943> 1786855 2 ayumi_kojima 2021-08-24 11:38:27 -0700 It seems like the test has been flaky since it was introduced here https://trac.webkit.org/changeset/281323/webkit 1786861 3 ayumi_kojima 2021-08-24 11:48:40 -0700 Updated test expectations https://trac.webkit.org/changeset/281507/webkit 1786862 4 pangle 2021-08-24 11:49:14 -0700 I think the timing in this test is too tight since we need to receive the message from the test WebSocket server while paused for debugging in the test. I'll tweak the timing. 1787464 5 436470 pangle 2021-08-25 22:02:54 -0700 Created attachment 436470 Patch v1.0 1787465 6 436470 pangle 2021-08-25 22:04:01 -0700 Comment on attachment 436470 Patch v1.0 Manually verified locally that 1000 iterations pass with `run-webkit-tests --iterations=1000 --exit-after-n-crashes-or-timeouts=1 --exit-after-n-failures=1 LayoutTests/http/tests/websocket/tests/hybi/inspector/send-and-recieve-debugger.html` 1787807 7 436470 hi 2021-08-26 14:37:53 -0700 Comment on attachment 436470 Patch v1.0 rs=me 1787818 8 ews-feeder 2021-08-26 14:59:28 -0700 Committed r281658 (241011@main): <https://commits.webkit.org/241011@main> All reviewed patches have been landed. Closing bug and clearing flags on attachment 436470. 436470 2021-08-25 22:02:54 -0700 2021-08-26 14:59:29 -0700 Patch v1.0 bug-229459-20210825220253.patch text/plain 4015 pangle U3VidmVyc2lvbiBSZXZpc2lvbjogMjgxNTEzCmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggMjRmNTdkMGI1NzFjMDJjOGU4M2Qz N2Y4YTA0NGQxNjFiM2JhZGEzNi4uZjM1MjIwMDRkNGVkZjU3OGViMTkxNDY4YzZmNjMwZmVhOGY3 ZTNhNCAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDE4IEBACisyMDIxLTA4LTI1ICBQYXRyaWNrIEFuZ2xlICA8 cGFuZ2xlQGFwcGxlLmNvbT4KKworICAgICAgICBbIEVXUyBDYXRhbGluYSBdIGh0dHAvdGVzdHMv d2Vic29ja2V0L3Rlc3RzL2h5YmkvaW5zcGVjdG9yL3NlbmQtYW5kLXJlY2lldmUtZGVidWdnZXIu aHRtbCBpcyBmbGFreSB0aW1pbmcgb3V0IC8gZmFpbGluZworICAgICAgICBodHRwczovL2J1Z3Mu d2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9MjI5NDU5CisKKyAgICAgICAgUmV2aWV3ZWQgYnkg Tk9CT0RZIChPT1BTISkuCisKKyAgICAgICAgSW5jcmVhc2UgdGltaW5ncyBzbGlnaHRseSB0byB3 aWRlbiB0aGUgd2luZG93IGR1cmluZyB3aGljaCB3ZSByZWNlaXZlIG1lc3NhZ2VzIHdoaWxlIHBh dXNlZCBpbiB0aGUgZGVidWdnZXIgYW5kCisgICAgICAgIGFsc28gZGVsYXkgdGhlIGVjaG8gc2Vy dmVyJ3MgcmVzcG9uc2UgZnVydGhlci4KKworICAgICAgICAqIGh0dHAvdGVzdHMvd2Vic29ja2V0 L3Rlc3RzL2h5YmkvaW5zcGVjdG9yL2VjaG8tZGVsYXllZF93c2gucHk6CisgICAgICAgICh3ZWJf c29ja2V0X3RyYW5zZmVyX2RhdGEpOgorICAgICAgICAqIGh0dHAvdGVzdHMvd2Vic29ja2V0L3Rl c3RzL2h5YmkvaW5zcGVjdG9yL3NlbmQtYW5kLXJlY2lldmUtZGVidWdnZXIuaHRtbDoKKyAgICAg ICAgKiBwbGF0Zm9ybS9tYWMvVGVzdEV4cGVjdGF0aW9uczoKKwogMjAyMS0wOC0yNCAgQWxleCBD aHJpc3RlbnNlbiAgPGFjaHJpc3RlbnNlbkB3ZWJraXQub3JnPgogCiAgICAgICAgIFVucHJlZml4 IC13ZWJraXQtYmFja2ZhY2UtdmlzaWJpbGl0eQpkaWZmIC0tZ2l0IGEvTGF5b3V0VGVzdHMvaHR0 cC90ZXN0cy93ZWJzb2NrZXQvdGVzdHMvaHliaS9pbnNwZWN0b3IvZWNoby1kZWxheWVkX3dzaC5w eSBiL0xheW91dFRlc3RzL2h0dHAvdGVzdHMvd2Vic29ja2V0L3Rlc3RzL2h5YmkvaW5zcGVjdG9y L2VjaG8tZGVsYXllZF93c2gucHkKaW5kZXggMmVkNWIwM2E2Y2E2YjcwNzIyMDY4OWMxNjc1NTFh ZTkyM2FlNjNjMS4uYWY1YjA5NmM4MTE0MmZkYmVkMjM5NDJlNDkwN2Q1MjM3OWI0MWE3MyAxMDA2 NDQKLS0tIGEvTGF5b3V0VGVzdHMvaHR0cC90ZXN0cy93ZWJzb2NrZXQvdGVzdHMvaHliaS9pbnNw ZWN0b3IvZWNoby1kZWxheWVkX3dzaC5weQorKysgYi9MYXlvdXRUZXN0cy9odHRwL3Rlc3RzL3dl YnNvY2tldC90ZXN0cy9oeWJpL2luc3BlY3Rvci9lY2hvLWRlbGF5ZWRfd3NoLnB5CkBAIC05LDUg KzksNSBAQCBkZWYgd2ViX3NvY2tldF9kb19leHRyYV9oYW5kc2hha2UocmVxdWVzdCk6CiBkZWYg d2ViX3NvY2tldF90cmFuc2Zlcl9kYXRhKHJlcXVlc3QpOgogICAgICMgRWNobyBtZXNzYWdlIGJh Y2sKICAgICBtZXNzYWdlID0gbXNndXRpbC5yZWNlaXZlX21lc3NhZ2UocmVxdWVzdCkKLSAgICBz bGVlcCgwLjEpCisgICAgc2xlZXAoMC4yNSkKICAgICBtc2d1dGlsLnNlbmRfbWVzc2FnZShyZXF1 ZXN0LCBtZXNzYWdlKQpkaWZmIC0tZ2l0IGEvTGF5b3V0VGVzdHMvaHR0cC90ZXN0cy93ZWJzb2Nr ZXQvdGVzdHMvaHliaS9pbnNwZWN0b3Ivc2VuZC1hbmQtcmVjaWV2ZS1kZWJ1Z2dlci5odG1sIGIv TGF5b3V0VGVzdHMvaHR0cC90ZXN0cy93ZWJzb2NrZXQvdGVzdHMvaHliaS9pbnNwZWN0b3Ivc2Vu ZC1hbmQtcmVjaWV2ZS1kZWJ1Z2dlci5odG1sCmluZGV4IDVhMzM3MGY0YTBhNjJkNTA2OWJiMzQx MDUzNDY1OTk2Yzk0MmI2ZmMuLjQ3NjYzODA1OWQzNmE1NTMyNTI3MDU0YmIzNDZlZGFlZGEzZThi MjAgMTAwNjQ0Ci0tLSBhL0xheW91dFRlc3RzL2h0dHAvdGVzdHMvd2Vic29ja2V0L3Rlc3RzL2h5 YmkvaW5zcGVjdG9yL3NlbmQtYW5kLXJlY2lldmUtZGVidWdnZXIuaHRtbAorKysgYi9MYXlvdXRU ZXN0cy9odHRwL3Rlc3RzL3dlYnNvY2tldC90ZXN0cy9oeWJpL2luc3BlY3Rvci9zZW5kLWFuZC1y ZWNpZXZlLWRlYnVnZ2VyLmh0bWwKQEAgLTUwLDEyICs1MCwxMiBAQCBmdW5jdGlvbiB0ZXN0KCkK ICAgICAgICAgICAgICAgICAgICAgICAgIEluc3BlY3RvclRlc3QubG9nKCJQYXVzaW5nIHNjcmlw dCBleGVjdXRpb24gd2l0aCBgZGVidWdnZXJgIHN0YXRlbWVudC4iKTsKICAgICAgICAgICAgICAg ICAgICAgICAgIEluc3BlY3RvclRlc3QuZXZhbHVhdGVJblBhZ2UoYGRlYnVnZ2VyYCk7CiAKLSAg ICAgICAgICAgICAgICAgICAgICAgIC8vIFRoZSBXZWJTb2NrZXQgZWNob3Mgd2l0aCBhIDEwMG1z IGRlbGF5LCBzbyB3YWl0IGEgYml0IGxvbmdlciB0aGFuIHRoYXQgYmVmb3JlIHJlc3VtaW5nIHRv CisgICAgICAgICAgICAgICAgICAgICAgICAvLyBUaGUgV2ViU29ja2V0IGVjaG9zIHdpdGggYSAy NTBtcyBkZWxheSwgc28gd2FpdCBhIGJpdCBsb25nZXIgdGhhbiB0aGF0IGJlZm9yZSByZXN1bWlu ZyB0bwogICAgICAgICAgICAgICAgICAgICAgICAgLy8gZW5zdXJlIHdlIHJlY2VpdmUgdGhlIG1l c3NhZ2Ugd2hpbGUgc3RpbGwgcGF1c2VkLgogICAgICAgICAgICAgICAgICAgICAgICAgc2V0VGlt ZW91dCgoKSA9PiB7CiAgICAgICAgICAgICAgICAgICAgICAgICAJSW5zcGVjdG9yVGVzdC5sb2co IlJlc3VtaW5nIHNjcmlwdCBleGVjdXRpb24uIikKICAgICAgICAgICAgICAgICAgICAgICAgIAlX SS5kZWJ1Z2dlck1hbmFnZXIucmVzdW1lKCkuY2F0Y2gocmVqZWN0KTsKLSAgICAgICAgICAgICAg ICAgICAgICAgIH0sIDIwMCk7CisgICAgICAgICAgICAgICAgICAgICAgICB9LCA1MDApOwogICAg ICAgICAgICAgICAgICAgICB9IGVsc2UgaWYgKGZyYW1lQWRkZWRDb3VudCA9PT0gMikgewogCiAg ICAgICAgICAgICAgICAgICAgICAgICBJbnNwZWN0b3JUZXN0LmV4cGVjdEVxdWFsKGZyYW1lLmRh dGEsICJIZWxsbyBXb3JsZCEg0J/RgNC40LLQtdGCINCc0LjRgCEiLCAiRnJhbWUgZGF0YSBzaG91 bGQgYmUgJ0hlbGxvIFdvcmxkISDQn9GA0LjQstC10YIg0JzQuNGAISciKTsKZGlmZiAtLWdpdCBh L0xheW91dFRlc3RzL3BsYXRmb3JtL21hYy9UZXN0RXhwZWN0YXRpb25zIGIvTGF5b3V0VGVzdHMv cGxhdGZvcm0vbWFjL1Rlc3RFeHBlY3RhdGlvbnMKaW5kZXggYThhZDBiMmJmMmRhZThhMjNlOTU1 ZDdmMzBjYmE2ZDkxNzBjYTQ0Ny4uZjA5MjM4ZmM3NGM4ZGE0MGZiYmNjZmFjMTU5MmYwYmRkZDUy ZDZiYSAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvcGxhdGZvcm0vbWFjL1Rlc3RFeHBlY3RhdGlv bnMKKysrIGIvTGF5b3V0VGVzdHMvcGxhdGZvcm0vbWFjL1Rlc3RFeHBlY3RhdGlvbnMKQEAgLTY1 Niw4ICs2NTYsNiBAQCB3ZWJraXQub3JnL2IvMTMxNzE1IHRyYW5zaXRpb25zL2NhbmNlbC10cmFu c2l0aW9uLmh0bWwgWyBQYXNzIEZhaWx1cmUgXQogCiB3ZWJraXQub3JnL2IvODkxNTMgaHR0cC90 ZXN0cy93ZWJzb2NrZXQvdGVzdHMvaHliaS93b3JrZXJzL2Nsb3NlLmh0bWwgWyBQYXNzIEZhaWx1 cmUgXQogCi13ZWJraXQub3JnL2IvMjI5NDU5IFsgRGVidWcgXSBodHRwL3Rlc3RzL3dlYnNvY2tl dC90ZXN0cy9oeWJpL2luc3BlY3Rvci9zZW5kLWFuZC1yZWNpZXZlLWRlYnVnZ2VyLmh0bWwgWyBQ YXNzIEZhaWx1cmUgVGltZW91dCBdCi0KICMgPHJkYXI6Ly9wcm9ibGVtLzE2Njk2Mjk4Pgogd2Vi a2l0Lm9yZy9iLzEzMTg4NiB3ZWJnbC8xLjAuMy9jb25mb3JtYW5jZS90ZXh0dXJlcy90ZXh0dXJl LXNpemUtbGltaXQuaHRtbCBbIFBhc3MgRmFpbHVyZSBdCiB3ZWJraXQub3JnL2IvMTMxODg2IGZh c3QvY2FudmFzL3dlYmdsL3dlYmdsLWNvbXByZXNzZWQtdGV4dHVyZS1zaXplLWxpbWl0Lmh0bWwg WyBQYXNzIEZhaWx1cmUgVGltZW91dCBdCg==