227123 2021-06-17 08:02:45 -0700 [ews] Improve build summary about finding flaky test in ReRunWebKitTests 2021-06-17 09:05:45 -0700 1 1 1 Unclassified WebKit Tools / Tests WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 aakash_jain aakash_jain aakash_jain ap jbedard ryanhaddad webkit-bug-importer oldest_to_newest 1770633 0 aakash_jain 2021-06-17 08:02:45 -0700 Sometimes, when first layout-test run fails unexpectedly, and second layout-test run passes, build summary is set to "Found flaky test:" (e.g.: https://ews-build.webkit.org/#/builders/10/builds/96042), even though no flaky tests were found. This happens when first layout-test run fails unexpectedly, without generating list of failing tests. 1770635 1 431665 aakash_jain 2021-06-17 08:08:44 -0700 Created attachment 431665 Patch 1770661 2 ews-feeder 2021-06-17 09:04:22 -0700 Committed r278989 (238915@main): <https://commits.webkit.org/238915@main> All reviewed patches have been landed. Closing bug and clearing flags on attachment 431665. 1770662 3 webkit-bug-importer 2021-06-17 09:05:45 -0700 <rdar://problem/79454105> 431665 2021-06-17 08:08:44 -0700 2021-06-17 09:04:22 -0700 Patch bug-227123-20210617110843.patch text/plain 2982 aakash_jain SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl dmlzaW9uIDI3ODk4NikKKysrIFRvb2xzL0NoYW5nZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwz ICsxLDE0IEBACisyMDIxLTA2LTE3ICBBYWthc2ggSmFpbiAgPGFha2FzaF9qYWluQGFwcGxlLmNv bT4KKworICAgICAgICBbZXdzXSBJbXByb3ZlIGJ1aWxkIHN1bW1hcnkgYWJvdXQgZmluZGluZyBm bGFreSB0ZXN0IGluIFJlUnVuV2ViS2l0VGVzdHMKKyAgICAgICAgaHR0cHM6Ly9idWdzLndlYmtp dC5vcmcvc2hvd19idWcuY2dpP2lkPTIyNzEyMworCisgICAgICAgIFJldmlld2VkIGJ5IE5PQk9E WSAoT09QUyEpLgorCisgICAgICAgICogQ0lTdXBwb3J0L2V3cy1idWlsZC9zdGVwcy5weToKKyAg ICAgICAgKFJlUnVuV2ViS2l0VGVzdHMuZXZhbHVhdGVDb21tYW5kKToKKyAgICAgICAgKiBDSVN1 cHBvcnQvZXdzLWJ1aWxkL3N0ZXBzX3VuaXR0ZXN0LnB5OgorCiAyMDIxLTA2LTE3ICBPcmlvbCBC cnVmYXUgIDxvYnJ1ZmF1QGlnYWxpYS5jb20+CiAKICAgICAgICAgW2Nzcy1sb2dpY2FsXSBJbXBs ZW1lbnQgbG9naWNhbCBwcm9wZXJ0eSBncm91cHMKSW5kZXg6IFRvb2xzL0NJU3VwcG9ydC9ld3Mt YnVpbGQvc3RlcHMucHkKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PQotLS0gVG9vbHMvQ0lTdXBwb3J0L2V3cy1idWlsZC9z dGVwcy5weQkocmV2aXNpb24gMjc4OTg2KQorKysgVG9vbHMvQ0lTdXBwb3J0L2V3cy1idWlsZC9z dGVwcy5weQkod29ya2luZyBjb3B5KQpAQCAtMjM1MCw3ICsyMzUwLDcgQEAgY2xhc3MgUmVSdW5X ZWJLaXRUZXN0cyhSdW5XZWJLaXRUZXN0cyk6CiAgICAgICAgICAgICBtZXNzYWdlID0gJ1Bhc3Nl ZCBsYXlvdXQgdGVzdHMnCiAgICAgICAgICAgICBzZWxmLmRlc2NyaXB0aW9uRG9uZSA9IG1lc3Nh Z2UKICAgICAgICAgICAgIHNlbGYuYnVpbGQucmVzdWx0cyA9IFNVQ0NFU1MKLSAgICAgICAgICAg IGlmIG5vdCBmaXJzdF9yZXN1bHRzX2RpZF9leGNlZWRfdGVzdF9mYWlsdXJlX2xpbWl0OgorICAg ICAgICAgICAgaWYgKG5vdCBmaXJzdF9yZXN1bHRzX2RpZF9leGNlZWRfdGVzdF9mYWlsdXJlX2xp bWl0KSBhbmQgZmxha3lfZmFpbHVyZXM6CiAgICAgICAgICAgICAgICAgcGx1cmFsU3VmZml4ID0g J3MnIGlmIGxlbihmbGFreV9mYWlsdXJlcykgPiAxIGVsc2UgJycKICAgICAgICAgICAgICAgICBt ZXNzYWdlID0gJ0ZvdW5kIGZsYWt5IHRlc3R7fToge30nLmZvcm1hdChwbHVyYWxTdWZmaXgsIGZs YWt5X2ZhaWx1cmVzX3N0cmluZykKICAgICAgICAgICAgICAgICBmb3IgZmxha3lfZmFpbHVyZSBp biBmbGFreV9mYWlsdXJlczoKSW5kZXg6IFRvb2xzL0NJU3VwcG9ydC9ld3MtYnVpbGQvc3RlcHNf dW5pdHRlc3QucHkKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PQotLS0gVG9vbHMvQ0lTdXBwb3J0L2V3cy1idWlsZC9zdGVw c191bml0dGVzdC5weQkocmV2aXNpb24gMjc4OTg2KQorKysgVG9vbHMvQ0lTdXBwb3J0L2V3cy1i dWlsZC9zdGVwc191bml0dGVzdC5weQkod29ya2luZyBjb3B5KQpAQCAtMTkxNSw2ICsxOTE1LDI0 IEBAIGNsYXNzIFRlc3RSZVJ1bldlYktpdFRlc3RzKFRlc3RSdW5XZWJLaXQKICAgICAgICAgc2Vs Zi5hc3NlcnRFcXVhbChzZWxmLmdldFByb3BlcnR5KCdidWlsZF9zdW1tYXJ5JyksICdGb3VuZCBm bGFreSB0ZXN0czogdGVzdDEsIHRlc3QyJykKICAgICAgICAgcmV0dXJuIHJjCiAKKyAgICBkZWYg dGVzdF9maXJzdF9ydW5fZmFpbGVkX3VuZXhwZWN0ZWRseShzZWxmKToKKyAgICAgICAgc2VsZi5j b25maWd1cmVTdGVwKCkKKyAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgnZnVsbFBsYXRmb3JtJywg J2lvcy1zaW11bGF0b3InKQorICAgICAgICBzZWxmLnNldFByb3BlcnR5KCdjb25maWd1cmF0aW9u JywgJ3JlbGVhc2UnKQorICAgICAgICBzZWxmLnNldFByb3BlcnR5KCdmaXJzdF9ydW5fZmFpbHVy ZXMnLCBbXSkKKyAgICAgICAgc2VsZi5leHBlY3RSZW1vdGVDb21tYW5kcygKKyAgICAgICAgICAg IEV4cGVjdFNoZWxsKHdvcmtkaXI9J3drZGlyJywKKyAgICAgICAgICAgICAgICAgICAgICAgIGxv Z2ZpbGVzPXsnanNvbic6IHNlbGYuanNvbkZpbGVOYW1lfSwKKyAgICAgICAgICAgICAgICAgICAg ICAgIGxvZ0Vudmlyb249RmFsc2UsCisgICAgICAgICAgICAgICAgICAgICAgICBjb21tYW5kPVsn cHl0aG9uJywgJ1Rvb2xzL1NjcmlwdHMvcnVuLXdlYmtpdC10ZXN0cycsICctLW5vLWJ1aWxkJywg Jy0tbm8tc2hvdy1yZXN1bHRzJywgJy0tbm8tbmV3LXRlc3QtcmVzdWx0cycsICctLWNsb2JiZXIt b2xkLXJlc3VsdHMnLCAnLS1yZWxlYXNlJywgJy0tcmVzdWx0cy1kaXJlY3RvcnknLCAnbGF5b3V0 LXRlc3QtcmVzdWx0cycsICctLWRlYnVnLXJ3dC1sb2dnaW5nJywgJy0tZXhpdC1hZnRlci1uLWZh aWx1cmVzJywgJzMwJywgJy0tc2tpcC1mYWlsaW5nLXRlc3RzJ10sCisgICAgICAgICAgICAgICAg ICAgICAgICApCisgICAgICAgICAgICArIDAsCisgICAgICAgICkKKyAgICAgICAgc2VsZi5leHBl Y3RPdXRjb21lKHJlc3VsdD1TVUNDRVNTLCBzdGF0ZV9zdHJpbmc9J1Bhc3NlZCBsYXlvdXQgdGVz dHMnKQorICAgICAgICByYyA9IHNlbGYucnVuU3RlcCgpCisgICAgICAgIHNlbGYuYXNzZXJ0RXF1 YWwoc2VsZi5nZXRQcm9wZXJ0eSgnYnVpbGRfc3VtbWFyeScpLCAnUGFzc2VkIGxheW91dCB0ZXN0 cycpCisgICAgICAgIHJldHVybiByYworCiAKIGNsYXNzIFRlc3RSdW5XZWJLaXRUZXN0c0luU3Ry ZXNzTW9kZShCdWlsZFN0ZXBNaXhpbkFkZGl0aW9ucywgdW5pdHRlc3QuVGVzdENhc2UpOgogICAg IGRlZiBzZXRVcChzZWxmKToK