214078 2020-07-08 05:57:46 -0700 REGRESSION: (r263222-263223): [ macOS wk2 debug ] accessibility/textarea-selected-text-range.html is flaky failing 2020-07-08 12:54:08 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 rackler ggaren aboxhall andresg_22 apinheiro cfleizach darin dmazzoni ews-watchlist ggaren jacob_uphoff jcraig jdiggs Lawrence.j rackler samuel_white webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1669728 0 rackler 2020-07-08 05:57:46 -0700 https://results.webkit.org/?suite=layout-tests&test=accessibility%2Ftextarea-selected-text-range.html&limit=50000&platform=mac&flavor=wk2&style=debug Description: The test is flaky failing on [ macOS wk2 debug ] release. It was passing consistently until 06/19/2020. History: https://results.webkit.org/?suite=layout-tests&test=accessibility%2Ftextarea-selected-text-range.html&limit=50000&platform=mac&flavor=wk2&style=debug Diff: --- /Volumes/Data/slave/catalina-debug-tests-wk2/build/layout-test-results/accessibility/textarea-selected-text-range-expected.txt +++ /Volumes/Data/slave/catalina-debug-tests-wk2/build/layout-test-results/accessibility/textarea-selected-text-range-actual.txt @@ -1,5 +1,5 @@ {4, 0} -{8, 2} +{4, 0} {25, 0} PASS successfullyParsed is true 1669729 1 webkit-bug-importer 2020-07-08 05:58:16 -0700 <rdar://problem/65220756> 1669730 2 403774 rackler 2020-07-08 06:11:42 -0700 Created attachment 403774 Patch 1669731 3 rackler 2020-07-08 06:17:31 -0700 I have marked this is a flaky test while the issue is investigated. 1669771 4 ews-feeder 2020-07-08 09:22:52 -0700 Tools/Scripts/svn-apply failed to apply attachment 403774 to trunk. Please resolve the conflicts and upload a new patch. 1669795 5 rackler 2020-07-08 10:48:29 -0700 I can reproduce this on r263223, but unable to reproduce on r263222. Commit: r264039 Command: run-webkit-tests --debug --iterations 500 --exit-after-n-failures 3 --debug --force -f accessibility/textarea-selected-text-range.html Result: [32/500] accessibility/textarea-selected-text-range.html failed unexpectedly (text diff) [36/500] accessibility/textarea-selected-text-range.html failed unexpectedly (text diff) [37/500] accessibility/textarea-selected-text-range.html failed unexpectedly (text diff) Exiting early after 3 failures. 29 tests run. 26 tests ran as expected, 3 didn't (471 didn't run): Regressions: Unexpected text-only failures (1) accessibility/textarea-selected-text-range.html [ Failure ] Commit: r263224 Command: run-webkit-tests --debug --iterations 500 --exit-after-n-failures 3 --debug --force -f accessibility/textarea-selected-text-range.html Result: [47/500] accessibility/textarea-selected-text-range.html failed unexpectedly (text diff) [52/500] accessibility/textarea-selected-text-range.html failed unexpectedly (text diff) [53/500] accessibility/textarea-selected-text-range.html failed unexpectedly (text diff) Exiting early after 3 failures. 42 tests run. 39 tests ran as expected, 3 didn't (458 didn't run): Regressions: Unexpected text-only failures (1) accessibility/textarea-selected-text-range.html [ Failure ] Commit: r223222 Command: run-webkit-tests --debug --iterations 500 --exit-after-n-failures 3 --debug --force -f accessibility/textarea-selected-text-range.html Result: All 500 tests ran as expected. 1669808 6 rackler 2020-07-08 11:05:14 -0700 Start on Geoff because the issue looks like it may be related to the "[Cocoa] Build callOnMainThread on WTF::RunLoop rather than on a timer" in r263223 Commit: r263223 Command: run-webkit-tests --debug --iterations 500 --exit-after-n-failures 3 --debug --force -f accessibility/textarea-selected-text-range.html Result: [47/500] accessibility/textarea-selected-text-range.html failed unexpectedly (text diff) [52/500] accessibility/textarea-selected-text-range.html failed unexpectedly (text diff) [53/500] accessibility/textarea-selected-text-range.html failed unexpectedly (text diff) Exiting early after 3 failures. 42 tests run. 39 tests ran as expected, 3 didn't (458 didn't run): Regressions: Unexpected text-only failures (1) accessibility/textarea-selected-text-range.html [ Failure ] 1669834 7 Lawrence.j 2020-07-08 11:45:54 -0700 I have marked this test as flaky failing while this issue is investigated. https://trac.webkit.org/changeset/264123/webkit 1669849 8 403802 ggaren 2020-07-08 12:30:08 -0700 Created attachment 403802 Patch 1669852 9 403802 darin 2020-07-08 12:33:31 -0700 Comment on attachment 403802 Patch View in context: https://bugs.webkit.org/attachment.cgi?id=403802&action=review > LayoutTests/ChangeLog:8 > + Make this test deterministic by waiting for the correct result. With no time limit other than the test runner’s own limit! 1669861 10 ews-feeder 2020-07-08 12:54:07 -0700 Committed r264129: <https://trac.webkit.org/changeset/264129> All reviewed patches have been landed. Closing bug and clearing flags on attachment 403802. 403774 2020-07-08 06:11:42 -0700 2020-07-08 12:30:06 -0700 Patch bug-214078-20200708081141.patch text/plain 1422 rackler U3VidmVyc2lvbiBSZXZpc2lvbjogMjY0MDk3CmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggNTVlYTViMmIyMzFiNjkyYmE5YmY4 OTJmNmQyYzk0NmY0NzllNDU3YS4uNzc3NjhkOGVlMGQzMDdiMmVjYzc0MTUzMmE4ZjlkOWEyY2I2 NjYzZSAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDEyIEBACisyMDIwLTA3LTA4ICBLYXJsIFJhY2tsZXIgIDxy YWNrbGVyQGFwcGxlLmNvbT4KKworICAgICAgICBbIG1hY09TIHdrMiBkZWJ1ZyBdIGFjY2Vzc2li aWxpdHkvdGV4dGFyZWEtc2VsZWN0ZWQtdGV4dC1yYW5nZS5odG1sIGlzIGZsYWt5IGZhaWxpbmcg CisgICAgICAgIGh0dHBzOi8vYnVncy53ZWJraXQub3JnL3Nob3dfYnVnLmNnaT9pZD0yMTQwNzgK KworICAgICAgICBVbnJldmlld2VkIHRlc3QgZ2FyZGVuaW5nLgorCisgICAgICAgICogcGxhdGZv cm0vbWFjLXdrMi9UZXN0RXhwZWN0YXRpb25zOgorCiAyMDIwLTA3LTA4ICBYYWJpZXIgUm9kcmln dWV6IENhbHZhciAgPGNhbHZhcmlzQGlnYWxpYS5jb20+CiAKICAgICAgICAgW0VNRV1bR1N0cmVh bWVyXSB3ZWItcGxhdGZvcm0tdGVzdHMvZW5jcnlwdGVkLW1lZGlhL2NsZWFya2V5LWV2ZW50cy1z ZXNzaW9uLWNsb3NlZC1ldmVudC5odHRwcy5odG1sIHJhbmRvbSBjcmFzaGVzCmRpZmYgLS1naXQg YS9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9tYWMtd2syL1Rlc3RFeHBlY3RhdGlvbnMgYi9MYXlvdXRU ZXN0cy9wbGF0Zm9ybS9tYWMtd2syL1Rlc3RFeHBlY3RhdGlvbnMKaW5kZXggZjU1MDNmOGE4ZmM4 YTI5MDY1MTg0ZDYxZjEzODNlMGIxMzdmYjc3OS4uYTUyYjZkOTdkMTAzNTA1ODZmZjYyNjdmMzk2 OWNjYTg0ZDA0MjgxNyAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvcGxhdGZvcm0vbWFjLXdrMi9U ZXN0RXhwZWN0YXRpb25zCisrKyBiL0xheW91dFRlc3RzL3BsYXRmb3JtL21hYy13azIvVGVzdEV4 cGVjdGF0aW9ucwpAQCAtMTAzOCwzICsxMDM4LDUgQEAgd2Via2l0Lm9yZy9iLzIxMzU1MyBodHRw L3Rlc3RzL3Jlc291cmNlTG9hZFN0YXRpc3RpY3MvZ3JhbmRmYXRoZXJpbmctZGF0YWJhc2UuaHQK IHdlYmtpdC5vcmcvYi8yMTM2MjEgaW1wb3J0ZWQvdzNjL3dlYi1wbGF0Zm9ybS10ZXN0cy93ZWJy dGMvUlRDUnRwUmVjZWl2ZXItZ2V0Q29udHJpYnV0aW5nU291cmNlcy5odHRwcy5odG1sIFsgUGFz cyBGYWlsdXJlIF0KIAogd2Via2l0Lm9yZy9iLzIxMzY1MiB3ZWJydGMvdmlkZW8tYXV0b3BsYXkx Lmh0bWwgWyBQYXNzIEZhaWx1cmUgXQorCit3ZWJraXQub3JnL2IvMjE0MDc4IGFjY2Vzc2liaWxp dHkvdGV4dGFyZWEtc2VsZWN0ZWQtdGV4dC1yYW5nZS5odG1sIFsgUGFzcyBGYWlsdXJlIF0K 403802 2020-07-08 12:30:08 -0700 2020-07-08 12:54:07 -0700 Patch bug-214078-20200708123008.patch text/plain 4001 ggaren SW5kZXg6IExheW91dFRlc3RzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBMYXlvdXRUZXN0cy9D aGFuZ2VMb2cJKHJldmlzaW9uIDI2NDEyNSkKKysrIExheW91dFRlc3RzL0NoYW5nZUxvZwkod29y a2luZyBjb3B5KQpAQCAtMSwzICsxLDE1IEBACisyMDIwLTA3LTA4ICBHZW9mZnJleSBHYXJlbiAg PGdnYXJlbkBhcHBsZS5jb20+CisKKyAgICAgICAgUkVHUkVTU0lPTjogKHIyNjMyMjItMjYzMjIz KTogWyBtYWNPUyB3azIgZGVidWcgXSBhY2Nlc3NpYmlsaXR5L3RleHRhcmVhLXNlbGVjdGVkLXRl eHQtcmFuZ2UuaHRtbCBpcyBmbGFreSBmYWlsaW5nCisgICAgICAgIGh0dHBzOi8vYnVncy53ZWJr aXQub3JnL3Nob3dfYnVnLmNnaT9pZD0yMTQwNzgKKworICAgICAgICBSZXZpZXdlZCBieSBOT0JP RFkgKE9PUFMhKS4KKworICAgICAgICBNYWtlIHRoaXMgdGVzdCBkZXRlcm1pbmlzdGljIGJ5IHdh aXRpbmcgZm9yIHRoZSBjb3JyZWN0IHJlc3VsdC4KKworICAgICAgICAqIGFjY2Vzc2liaWxpdHkv dGV4dGFyZWEtc2VsZWN0ZWQtdGV4dC1yYW5nZS1leHBlY3RlZC50eHQ6CisgICAgICAgICogYWNj ZXNzaWJpbGl0eS90ZXh0YXJlYS1zZWxlY3RlZC10ZXh0LXJhbmdlLmh0bWw6CisKIDIwMjAtMDct MDggIFRydWl0dCBTYXZlbGwgIDx0c2F2ZWxsQGFwcGxlLmNvbT4KIAogICAgICAgICBSZWdyZXNz aW9uKHIyNjE3NTYpOiB3ZWJhbmltYXRpb25zL2FjY2VsZXJhdGVkLWFuaW1hdGlvbi1zaW5nbGUt a2V5ZnJhbWUuaHRtbCBpcyBjb25zaXN0ZW50bHkgdGltaW5nIG91dCBvbiB3aW5kb3dzCkluZGV4 OiBMYXlvdXRUZXN0cy9hY2Nlc3NpYmlsaXR5L3RleHRhcmVhLXNlbGVjdGVkLXRleHQtcmFuZ2Ut ZXhwZWN0ZWQudHh0Cj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIExheW91dFRlc3RzL2FjY2Vzc2liaWxpdHkvdGV4 dGFyZWEtc2VsZWN0ZWQtdGV4dC1yYW5nZS1leHBlY3RlZC50eHQJKHJldmlzaW9uIDI2NDAzMikK KysrIExheW91dFRlc3RzL2FjY2Vzc2liaWxpdHkvdGV4dGFyZWEtc2VsZWN0ZWQtdGV4dC1yYW5n ZS1leHBlY3RlZC50eHQJKHdvcmtpbmcgY29weSkKQEAgLTEsNiArMSw2IEBACi17NCwgMH0KLXs4 LCAyfQotezI1LCAwfQorUEFTUzogdGV4dEFyZWEuc2VsZWN0ZWRUZXh0UmFuZ2UgaXMgezQsIDB9 CitQQVNTOiB0ZXh0QXJlYS5zZWxlY3RlZFRleHRSYW5nZSBpcyB7OCwgMn0KK1BBU1M6IHRleHRB cmVhLnNlbGVjdGVkVGV4dFJhbmdlIGlzIHsyNSwgMH0KIFBBU1Mgc3VjY2Vzc2Z1bGx5UGFyc2Vk IGlzIHRydWUKIAogVEVTVCBDT01QTEVURQpJbmRleDogTGF5b3V0VGVzdHMvYWNjZXNzaWJpbGl0 eS90ZXh0YXJlYS1zZWxlY3RlZC10ZXh0LXJhbmdlLmh0bWwKPT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PQotLS0gTGF5b3V0 VGVzdHMvYWNjZXNzaWJpbGl0eS90ZXh0YXJlYS1zZWxlY3RlZC10ZXh0LXJhbmdlLmh0bWwJKHJl dmlzaW9uIDI2NDAzMikKKysrIExheW91dFRlc3RzL2FjY2Vzc2liaWxpdHkvdGV4dGFyZWEtc2Vs ZWN0ZWQtdGV4dC1yYW5nZS5odG1sCSh3b3JraW5nIGNvcHkpCkBAIC0xMSwzMCArMTEsNDggQEAg bGluZSAzCiAgICAgPC90ZXh0YXJlYT4KIAogPHNjcmlwdD4KKyAgICBmdW5jdGlvbiB3YWl0Rm9y KGNvbmRpdGlvbikKKyAgICB7CisgICAgICAgIHJldHVybiBuZXcgUHJvbWlzZSgocmVzb2x2ZSwg cmVqZWN0KSA9PiB7CisgICAgICAgICAgICBsZXQgaW50ZXJ2YWwgPSBzZXRJbnRlcnZhbCgoKSA9 PiB7CisgICAgICAgICAgICAgICAgaWYgKGNvbmRpdGlvbigpKSB7CisgICAgICAgICAgICAgICAg ICAgIGNsZWFySW50ZXJ2YWwoaW50ZXJ2YWwpOworICAgICAgICAgICAgICAgICAgICByZXNvbHZl KCk7CisgICAgICAgICAgICAgICAgfQorICAgICAgICAgICAgfSwgMCk7CisgICAgICAgIH0pOwor ICAgIH0KKwogICAgIGlmICh3aW5kb3cuYWNjZXNzaWJpbGl0eUNvbnRyb2xsZXIpIHsKICAgICAg ICAgd2luZG93LmpzVGVzdElzQXN5bmMgPSB0cnVlOwogICAgICAgICB2YXIgYXJlYTEgPSBkb2N1 bWVudC5nZXRFbGVtZW50QnlJZCgiYXJlYTEiKTsKICAgICAgICAgYXJlYTEuZm9jdXMoKTsKLSAg ICAgICAgc2V0VGltZW91dChmdW5jdGlvbigpIHsKKworICAgICAgICBzZXRUaW1lb3V0KGFzeW5j IGZ1bmN0aW9uKCkgewogICAgICAgICAgICAgdmFyIHRleHRBcmVhID0gYWNjZXNzaWJpbGl0eUNv bnRyb2xsZXIuZm9jdXNlZEVsZW1lbnQ7CisKKyAgICAgICAgICAgIC8vIGFjY2Vzc2liaWxpdHlD b250cm9sbGVyIHJ1bnMgaXRzIGNvZGUgb24gYSBzZWNvbmRhcnkgdGhyZWFkIHdpdGhvdXQKKyAg ICAgICAgICAgIC8vIGV4cGxpY2l0IHN5bmNocm9uaXphdGlvbiwgc28gY2hhbmdlcyBzaG93IHVw IGF0IHVucHJlZGljdGFibGUgdGltZXMuCisKICAgICAgICAgICAgIHRleHRBcmVhLnNldFNlbGVj dGVkVGV4dFJhbmdlKDQsIDApOworICAgICAgICAgICAgYXdhaXQgd2FpdEZvcigoKSA9PiB7Cisg ICAgICAgICAgICAgICAgcmV0dXJuIHRleHRBcmVhLnNlbGVjdGVkVGV4dFJhbmdlID09ICJ7NCwg MH0iOworICAgICAgICAgICAgfSk7CisgICAgICAgICAgICBkZWJ1ZygiUEFTUzogdGV4dEFyZWEu c2VsZWN0ZWRUZXh0UmFuZ2UgaXMgezQsIDB9Iik7CiAKLSAgICAgICAgICAgIC8vIEFmdGVyIHNl dHRpbmcgYSBwcm9wZXJ0eSB0aHJvdWdoIGFjY2Vzc2liaWxpdHksIHRoZSB2YWx1ZSB3b24ndCBi ZSB1cGRhdGVkIGltbWVkaWF0ZWx5LCBzbyB3ZQotICAgICAgICAgICAgLy8gbXVzdCBjaGVjayBh ZnRlciBhIHRpbWVvdXQgdG8gcmUtdmVyaWZ5IHRoZSB2YWx1ZS4KLSAgICAgICAgICAgIHNldFRp bWVvdXQoZnVuY3Rpb24oKSB7Ci0gICAgICAgICAgICAgICAgZGVidWcodGV4dEFyZWEuc2VsZWN0 ZWRUZXh0UmFuZ2UpOwotCi0gICAgICAgICAgICAgICAgdGV4dEFyZWEuc2V0U2VsZWN0ZWRUZXh0 UmFuZ2UoOCwyKTsKLSAgICAgICAgICAgICAgICBzZXRUaW1lb3V0KGZ1bmN0aW9uKCkgewotICAg ICAgICAgICAgICAgICAgICBkZWJ1Zyh0ZXh0QXJlYS5zZWxlY3RlZFRleHRSYW5nZSk7Ci0KLSAg ICAgICAgICAgICAgICAgICAgdGV4dEFyZWEuc2V0U2VsZWN0ZWRUZXh0UmFuZ2UoMTAwLDApOwot ICAgICAgICAgICAgICAgICAgICBzZXRUaW1lb3V0KGZ1bmN0aW9uKCkgewotICAgICAgICAgICAg ICAgICAgICAgICAgZGVidWcodGV4dEFyZWEuc2VsZWN0ZWRUZXh0UmFuZ2UpOwotICAgICAgICAg ICAgICAgICAgICAgICAgZmluaXNoSlNUZXN0KCk7Ci0gICAgICAgICAgICAgICAgICAgIH0sIDAp OwotICAgICAgICAgICAgICAgIH0sIDApOwotICAgICAgICAgICAgfSwgMCk7CisgICAgICAgICAg ICB0ZXh0QXJlYS5zZXRTZWxlY3RlZFRleHRSYW5nZSg4LCAyKTsKKyAgICAgICAgICAgIGF3YWl0 IHdhaXRGb3IoKCkgPT4geworICAgICAgICAgICAgICAgIHJldHVybiB0ZXh0QXJlYS5zZWxlY3Rl ZFRleHRSYW5nZSA9PSAiezgsIDJ9IjsKKyAgICAgICAgICAgIH0pOworICAgICAgICAgICAgZGVi dWcoIlBBU1M6IHRleHRBcmVhLnNlbGVjdGVkVGV4dFJhbmdlIGlzIHs4LCAyfSIpOworCisgICAg ICAgICAgICB0ZXh0QXJlYS5zZXRTZWxlY3RlZFRleHRSYW5nZSgxMDAsIDApOworICAgICAgICAg ICAgYXdhaXQgd2FpdEZvcigoKSA9PiB7CisgICAgICAgICAgICAgICAgcmV0dXJuIHRleHRBcmVh LnNlbGVjdGVkVGV4dFJhbmdlID09ICJ7MjUsIDB9IjsKKyAgICAgICAgICAgIH0pOworICAgICAg ICAgICAgZGVidWcoIlBBU1M6IHRleHRBcmVhLnNlbGVjdGVkVGV4dFJhbmdlIGlzIHsyNSwgMH0i KTsKKworICAgICAgICAgICAgZmluaXNoSlNUZXN0KCk7CiAgICAgICAgIH0sIDApOwogICAgIH0K IDwvc2NyaXB0Pgo=