207475 2020-02-10 10:07:15 -0800 [ews] Notify bot watchers about pre-existing and flaky test failures found on ews bots 2020-09-04 05:09:15 -0700 1 1 1 Unclassified WebKit Tools / Tests WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED https://bugs.webkit.org/show_bug.cgi?id=214727 https://bugs.webkit.org/show_bug.cgi?id=214693 https://bugs.webkit.org/show_bug.cgi?id=214841 https://bugs.webkit.org/show_bug.cgi?id=215274 https://bugs.webkit.org/show_bug.cgi?id=215948 https://bugs.webkit.org/show_bug.cgi?id=215949 InRadar P2 Normal --- 214670 1 ryanhaddad aakash_jain aakash_jain ap jbedard ryanhaddad webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1616931 0 ryanhaddad 2020-02-10 10:07:15 -0800 [ews-build] Create a mechanism to notify interested parties about pre-existing test failures found on bots 1616933 1 webkit-bug-importer 2020-02-10 10:07:35 -0800 <rdar://problem/59314769> 1674224 2 405040 aakash_jain 2020-07-23 08:35:12 -0700 Created attachment 405040 Patch 1674321 3 405067 aakash_jain 2020-07-23 12:45:08 -0700 Created attachment 405067 Patch 1674376 4 405067 jbedard 2020-07-23 14:39:35 -0700 Comment on attachment 405067 Patch View in context: https://bugs.webkit.org/attachment.cgi?id=405067&action=review > Tools/BuildSlaveSupport/ews-build/steps.py:1871 > + self.send_email_for_flaky_failure(flaky_failure) Do we have any understanding of how much email this is going to generate? Seems like it would be a ton. Are the recipients prepared for that? > Tools/BuildSlaveSupport/ews-build/steps.py:2006 > + def send_email_for_pre_existing_failure(self, test_name): This seems way more useful then the flaky one at the moment, because there will be far less of them > Tools/BuildSlaveSupport/ews-build/steps_unittest.py:1745 > + def test_flaky_failures_in_first_run(self): What's the point of this test if we aren't testing the email sending in some way? 1674382 5 405067 aakash_jain 2020-07-23 14:50:02 -0700 Comment on attachment 405067 Patch View in context: https://bugs.webkit.org/attachment.cgi?id=405067&action=review >> Tools/BuildSlaveSupport/ews-build/steps.py:1871 >> + self.send_email_for_flaky_failure(flaky_failure) > > Do we have any understanding of how much email this is going to generate? > > Seems like it would be a ton. Are the recipients prepared for that? We created a new email address to receive these emails see: https://trac.webkit.org/changeset/264779/webkit Number of emails would vary based on how many flaky tests or pre-existing failures are there on a given day on trunk. We started these emails today, and we got 35 emails (26 for flaky tests and 9 for pre-existing test failures) so far. >> Tools/BuildSlaveSupport/ews-build/steps_unittest.py:1745 >> + def test_flaky_failures_in_first_run(self): > > What's the point of this test if we aren't testing the email sending in some way? This test is independent of this patch. I could have added it in a separate patch. 1674393 6 405067 jbedard 2020-07-23 15:03:02 -0700 Comment on attachment 405067 Patch View in context: https://bugs.webkit.org/attachment.cgi?id=405067&action=review >>> Tools/BuildSlaveSupport/ews-build/steps.py:1871 >>> + self.send_email_for_flaky_failure(flaky_failure) >> >> Do we have any understanding of how much email this is going to generate? >> >> Seems like it would be a ton. Are the recipients prepared for that? > > We created a new email address to receive these emails see: https://trac.webkit.org/changeset/264779/webkit > > Number of emails would vary based on how many flaky tests or pre-existing failures are there on a given day on trunk. We started these emails today, and we got 35 emails (26 for flaky tests and 9 for pre-existing test failures) so far. Does that mean we already have a version of this deployed? 1674396 7 aakash_jain 2020-07-23 15:07:21 -0700 (In reply to Jonathan Bedard from comment #6) > Does that mean we already have a version of this deployed? Yeah 1674410 8 ews-feeder 2020-07-23 15:20:28 -0700 Committed r264795: <https://trac.webkit.org/changeset/264795> All reviewed patches have been landed. Closing bug and clearing flags on attachment 405067. 405040 2020-07-23 08:35:12 -0700 2020-07-23 12:45:05 -0700 Patch bug-207475-20200723113511.patch text/plain 5255 aakash_jain SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl dmlzaW9uIDI2NDc2NCkKKysrIFRvb2xzL0NoYW5nZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwz ICsxLDE3IEBACisyMDIwLTA3LTIzICBBYWthc2ggSmFpbiAgPGFha2FzaF9qYWluQGFwcGxlLmNv bT4KKworICAgICAgICBbZXdzXSBOb3RpZnkgYm90IHdhdGNoZXJzIGFib3V0IHByZS1leGlzdGlu ZyBhbmQgZmxha3kgdGVzdCBmYWlsdXJlcyBmb3VuZCBvbiBld3MgYm90cworICAgICAgICBodHRw czovL2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9MjA3NDc1CisKKyAgICAgICAgUmV2 aWV3ZWQgYnkgTk9CT0RZIChPT1BTISkuCisKKyAgICAgICAgKiBCdWlsZFNsYXZlU3VwcG9ydC9l d3MtYnVpbGQvc3RlcHMucHk6CisgICAgICAgIChSZVJ1bldlYktpdFRlc3RzLmV2YWx1YXRlQ29t bWFuZCk6CisgICAgICAgIChSZVJ1bldlYktpdFRlc3RzLnNlbmRfZW1haWxfZm9yX2ZsYWt5X2Zh aWx1cmUpOiBNZXRob2QgdG8gc2VuZCBlbWFpbCBmb3IgZmxha3kgZmFpbHVyZS4KKyAgICAgICAg KEFuYWx5emVMYXlvdXRUZXN0c1Jlc3VsdHMucmVwb3J0X3ByZV9leGlzdGluZ19mYWlsdXJlcyk6 CisgICAgICAgIChBbmFseXplTGF5b3V0VGVzdHNSZXN1bHRzLnNlbmRfZW1haWxfZm9yX2ZsYWt5 X2ZhaWx1cmUpOiBNZXRob2QgdG8gc2VuZCBlbWFpbCBmb3IgZmxha3kgZmFpbHVyZS4KKyAgICAg ICAgKEFuYWx5emVMYXlvdXRUZXN0c1Jlc3VsdHMuc2VuZF9lbWFpbF9mb3JfcHJlX2V4aXN0aW5n X2ZhaWx1cmUpOiBNZXRob2QgdG8gc2VuZCBlbWFpbCBmb3IgcHJlLWV4aXN0aW5nIGZhaWx1cmUu CisKIDIwMjAtMDctMjMgIFhhYmllciBSb2RyaWd1ZXogQ2FsdmFyICA8Y2FsdmFyaXNAaWdhbGlh LmNvbT4KIAogICAgICAgICBbR1N0cmVhbWVyXSBnc3RfYnVmZmVyX3VubWFwOiBhc3NlcnRpb24g J0dTVF9JU19CVUZGRVIgKGJ1ZmZlciknIGZhaWxlZApJbmRleDogVG9vbHMvQnVpbGRTbGF2ZVN1 cHBvcnQvZXdzLWJ1aWxkL3N0ZXBzLnB5Cj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIFRvb2xzL0J1aWxkU2xhdmVT dXBwb3J0L2V3cy1idWlsZC9zdGVwcy5weQkocmV2aXNpb24gMjY0NzYyKQorKysgVG9vbHMvQnVp bGRTbGF2ZVN1cHBvcnQvZXdzLWJ1aWxkL3N0ZXBzLnB5CSh3b3JraW5nIGNvcHkpCkBAIC0yOSw2 ICsyOSw3IEBAIGZyb20gYnVpbGRib3Quc3RlcHMud29ya2VyIGltcG9ydCBDb21wb3MKIGZyb20g dHdpc3RlZC5pbnRlcm5ldCBpbXBvcnQgZGVmZXIKIAogZnJvbSBsYXlvdXRfdGVzdF9mYWlsdXJl cyBpbXBvcnQgTGF5b3V0VGVzdEZhaWx1cmVzCitmcm9tIHNlbmRfZW1haWwgaW1wb3J0IHNlbmRf ZW1haWxfdG9fYm90X3dhdGNoZXJzCiAKIGltcG9ydCBqc29uCiBpbXBvcnQgcmUKQEAgLTE4NjYs NiArMTg2Nyw4IEBAIGNsYXNzIFJlUnVuV2ViS2l0VGVzdHMoUnVuV2ViS2l0VGVzdHMpOgogICAg ICAgICAgICAgICAgIHBsdXJhbFN1ZmZpeCA9ICdzJyBpZiBsZW4oZmxha3lfZmFpbHVyZXMpID4g MSBlbHNlICcnCiAgICAgICAgICAgICAgICAgbWVzc2FnZSA9ICdGb3VuZCBmbGFreSB0ZXN0e306 IHt9Jy5mb3JtYXQocGx1cmFsU3VmZml4LCBmbGFreV9mYWlsdXJlc19zdHJpbmcpCiAgICAgICAg ICAgICBzZWxmLnNldFByb3BlcnR5KCdidWlsZF9zdW1tYXJ5JywgbWVzc2FnZSkKKyAgICAgICAg ICAgIGZvciBmbGFreV9mYWlsdXJlIGluIGZsYWt5X2ZhaWx1cmVzOgorICAgICAgICAgICAgICAg IHNlbGYuc2VuZF9lbWFpbF9mb3JfZmxha3lfZmFpbHVyZShmbGFreV9mYWlsdXJlKQogICAgICAg ICBlbHNlOgogICAgICAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgncGF0Y2hGYWlsZWRUZXN0cycs IFRydWUpCiAgICAgICAgICAgICBzZWxmLmJ1aWxkLmFkZFN0ZXBzQWZ0ZXJDdXJyZW50U3RlcChb QXJjaGl2ZVRlc3RSZXN1bHRzKCksCkBAIC0xODkzLDYgKzE4OTYsMTQgQEAgY2xhc3MgUmVSdW5X ZWJLaXRUZXN0cyhSdW5XZWJLaXRUZXN0cyk6CiAgICAgICAgICAgICAgICAgc2VsZi5fYWRkVG9M b2coc2VsZi50ZXN0X2ZhaWx1cmVzX2xvZ19uYW1lLCAnXG4nLmpvaW4oc2Vjb25kX3Jlc3VsdHMu ZmFpbGluZ190ZXN0cykpCiAgICAgICAgIHNlbGYuX3BhcnNlUnVuV2ViS2l0VGVzdHNPdXRwdXQo bG9nVGV4dCkKIAorICAgIGRlZiBzZW5kX2VtYWlsX2Zvcl9mbGFreV9mYWlsdXJlKHNlbGYsIHRl c3RfbmFtZSk6CisgICAgICAgIGJ1aWxkZXJfbmFtZSA9IHNlbGYuZ2V0UHJvcGVydHkoJ2J1aWxk ZXJuYW1lJywgJycpCisgICAgICAgIGJ1aWxkX3VybCA9ICd7fSMvYnVpbGRlcnMve30vYnVpbGRz L3t9Jy5mb3JtYXQoc2VsZi5tYXN0ZXIuY29uZmlnLmJ1aWxkYm90VVJMLCBzZWxmLmJ1aWxkLl9i dWlsZGVyaWQsIHNlbGYuYnVpbGQubnVtYmVyKQorCisgICAgICAgIGVtYWlsX3N1YmplY3QgPSAn Rmxha3kgdGVzdDoge30nLmZvcm1hdCh0ZXN0X25hbWUpCisgICAgICAgIGVtYWlsX3RleHQgPSAn VGVzdCB7fSBmbGFrZWQgaW4ge31cblxuQnVpbGRlcjoge30nLmZvcm1hdCh0ZXN0X25hbWUsIGJ1 aWxkX3VybCwgYnVpbGRlcl9uYW1lKQorICAgICAgICBzZW5kX2VtYWlsX3RvX2JvdF93YXRjaGVy cyhlbWFpbF9zdWJqZWN0LCBlbWFpbF90ZXh0KQorCiAKIGNsYXNzIFJ1bldlYktpdFRlc3RzV2l0 aG91dFBhdGNoKFJ1bldlYktpdFRlc3RzKToKICAgICBuYW1lID0gJ3J1bi1sYXlvdXQtdGVzdHMt d2l0aG91dC1wYXRjaCcKQEAgLTE5NTIsMTIgKzE5NjMsMTggQEAgY2xhc3MgQW5hbHl6ZUxheW91 dFRlc3RzUmVzdWx0cyhidWlsZHN0ZQogICAgICAgICAgICAgbWVzc2FnZSA9ICdGb3VuZCB7fSBw cmUtZXhpc3RpbmcgdGVzdCBmYWlsdXJle306IHt9Jy5mb3JtYXQobGVuKGNsZWFuX3RyZWVfZmFp bHVyZXMpLCBwbHVyYWxTdWZmaXgsIGNsZWFuX3RyZWVfZmFpbHVyZXNfc3RyaW5nKQogICAgICAg ICAgICAgaWYgbGVuKGNsZWFuX3RyZWVfZmFpbHVyZXMpID4gc2VsZi5OVU1fRkFJTFVSRVNfVE9f RElTUExBWToKICAgICAgICAgICAgICAgICBtZXNzYWdlICs9ICcgLi4uJworICAgICAgICAgICAg Zm9yIGNsZWFuX3RyZWVfZmFpbHVyZSBpbiBjbGVhbl90cmVlX2ZhaWx1cmVzOgorICAgICAgICAg ICAgICAgIHNlbGYuc2VuZF9lbWFpbF9mb3JfcHJlX2V4aXN0aW5nX2ZhaWx1cmUoY2xlYW5fdHJl ZV9mYWlsdXJlKQorCiAgICAgICAgIGlmIGZsYWt5X2ZhaWx1cmVzOgogICAgICAgICAgICAgZmxh a3lfZmFpbHVyZXNfc3RyaW5nID0gJywgJy5qb2luKHNvcnRlZChmbGFreV9mYWlsdXJlcylbOnNl bGYuTlVNX0ZBSUxVUkVTX1RPX0RJU1BMQVldKQogICAgICAgICAgICAgcGx1cmFsU3VmZml4ID0g J3MnIGlmIGxlbihmbGFreV9mYWlsdXJlcykgPiAxIGVsc2UgJycKICAgICAgICAgICAgIG1lc3Nh Z2UgKz0gJyBGb3VuZCBmbGFreSB0ZXN0e306IHt9Jy5mb3JtYXQocGx1cmFsU3VmZml4LCBmbGFr eV9mYWlsdXJlc19zdHJpbmcpCiAgICAgICAgICAgICBpZiBsZW4oZmxha3lfZmFpbHVyZXMpID4g c2VsZi5OVU1fRkFJTFVSRVNfVE9fRElTUExBWToKICAgICAgICAgICAgICAgICBtZXNzYWdlICs9 ICcgLi4uJworICAgICAgICAgICAgZm9yIGZsYWt5X2ZhaWx1cmUgaW4gZmxha3lfZmFpbHVyZXM6 CisgICAgICAgICAgICAgICAgc2VsZi5zZW5kX2VtYWlsX2Zvcl9mbGFreV9mYWlsdXJlKGZsYWt5 X2ZhaWx1cmUpCisKICAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgnYnVpbGRfc3VtbWFyeScsIG1l c3NhZ2UpCiAgICAgICAgIHJldHVybiBkZWZlci5zdWNjZWVkKE5vbmUpCiAKQEAgLTE5NzEsNiAr MTk4OCwyMiBAQCBjbGFzcyBBbmFseXplTGF5b3V0VGVzdHNSZXN1bHRzKGJ1aWxkc3RlCiAgICAg ZGVmIF9yZXN1bHRzX2ZhaWxlZF9kaWZmZXJlbnRfdGVzdHMoc2VsZiwgZmlyc3RfcmVzdWx0c19m YWlsaW5nX3Rlc3RzLCBzZWNvbmRfcmVzdWx0c19mYWlsaW5nX3Rlc3RzKToKICAgICAgICAgcmV0 dXJuIGZpcnN0X3Jlc3VsdHNfZmFpbGluZ190ZXN0cyAhPSBzZWNvbmRfcmVzdWx0c19mYWlsaW5n X3Rlc3RzCiAKKyAgICBkZWYgc2VuZF9lbWFpbF9mb3JfZmxha3lfZmFpbHVyZShzZWxmLCB0ZXN0 X25hbWUpOgorICAgICAgICBidWlsZGVyX25hbWUgPSBzZWxmLmdldFByb3BlcnR5KCdidWlsZGVy bmFtZScsICcnKQorICAgICAgICBidWlsZF91cmwgPSAne30jL2J1aWxkZXJzL3t9L2J1aWxkcy97 fScuZm9ybWF0KHNlbGYubWFzdGVyLmNvbmZpZy5idWlsZGJvdFVSTCwgc2VsZi5idWlsZC5fYnVp bGRlcmlkLCBzZWxmLmJ1aWxkLm51bWJlcikKKworICAgICAgICBlbWFpbF9zdWJqZWN0ID0gJ0Zs YWt5IHRlc3Q6IHt9Jy5mb3JtYXQodGVzdF9uYW1lKQorICAgICAgICBlbWFpbF90ZXh0ID0gJ1Rl c3Qge30gZmxha2VkIGluIHt9XG5cbkJ1aWxkZXI6IHt9Jy5mb3JtYXQodGVzdF9uYW1lLCBidWls ZF91cmwsIGJ1aWxkZXJfbmFtZSkKKyAgICAgICAgc2VuZF9lbWFpbF90b19ib3Rfd2F0Y2hlcnMo ZW1haWxfc3ViamVjdCwgZW1haWxfdGV4dCkKKworICAgIGRlZiBzZW5kX2VtYWlsX2Zvcl9wcmVf ZXhpc3RpbmdfZmFpbHVyZShzZWxmLCB0ZXN0X25hbWUpOgorICAgICAgICBidWlsZGVyX25hbWUg PSBzZWxmLmdldFByb3BlcnR5KCdidWlsZGVybmFtZScsICcnKQorICAgICAgICBidWlsZF91cmwg PSAne30jL2J1aWxkZXJzL3t9L2J1aWxkcy97fScuZm9ybWF0KHNlbGYubWFzdGVyLmNvbmZpZy5i dWlsZGJvdFVSTCwgc2VsZi5idWlsZC5fYnVpbGRlcmlkLCBzZWxmLmJ1aWxkLm51bWJlcikKKwor ICAgICAgICBlbWFpbF9zdWJqZWN0ID0gJ1ByZS1leGlzdGluZyB0ZXN0IGZhaWx1cmU6IHt9Jy5m b3JtYXQodGVzdF9uYW1lKQorICAgICAgICBlbWFpbF90ZXh0ID0gJ1Rlc3Qge30gZmFpbGVkIG9u IGNsZWFuIHRyZWUgcnVuIGluIHt9LlxuQnVpbGRlcjoge30nLmZvcm1hdCh0ZXN0X25hbWUsIGJ1 aWxkX3VybCwgYnVpbGRlcl9uYW1lKQorICAgICAgICBzZW5kX2VtYWlsX3RvX2JvdF93YXRjaGVy cyhlbWFpbF9zdWJqZWN0LCBlbWFpbF90ZXh0KQorCiAgICAgZGVmIF9yZXBvcnRfZmxha3lfdGVz dHMoc2VsZiwgZmxha3lfdGVzdHMpOgogICAgICAgICAjVE9ETzogaW1wbGVtZW50IHRoaXMKICAg ICAgICAgcGFzcwo= 405067 2020-07-23 12:45:08 -0700 2020-07-23 15:20:29 -0700 Patch bug-207475-20200723154507.patch text/plain 9445 aakash_jain SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl dmlzaW9uIDI2NDc2NCkKKysrIFRvb2xzL0NoYW5nZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwz ICsxLDE5IEBACisyMDIwLTA3LTIzICBBYWthc2ggSmFpbiAgPGFha2FzaF9qYWluQGFwcGxlLmNv bT4KKworICAgICAgICBbZXdzXSBOb3RpZnkgYm90IHdhdGNoZXJzIGFib3V0IHByZS1leGlzdGlu ZyBhbmQgZmxha3kgdGVzdCBmYWlsdXJlcyBmb3VuZCBvbiBld3MgYm90cworICAgICAgICBodHRw czovL2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9MjA3NDc1CisKKyAgICAgICAgUmV2 aWV3ZWQgYnkgTk9CT0RZIChPT1BTISkuCisKKyAgICAgICAgKiBCdWlsZFNsYXZlU3VwcG9ydC9l d3MtYnVpbGQvc3RlcHMucHk6CisgICAgICAgIChSZVJ1bldlYktpdFRlc3RzLmV2YWx1YXRlQ29t bWFuZCk6CisgICAgICAgIChSZVJ1bldlYktpdFRlc3RzLnNlbmRfZW1haWxfZm9yX2ZsYWt5X2Zh aWx1cmUpOiBNZXRob2QgdG8gc2VuZCBlbWFpbCBmb3IgZmxha3kgZmFpbHVyZS4KKyAgICAgICAg KEFuYWx5emVMYXlvdXRUZXN0c1Jlc3VsdHMucmVwb3J0X3ByZV9leGlzdGluZ19mYWlsdXJlcyk6 CisgICAgICAgIChBbmFseXplTGF5b3V0VGVzdHNSZXN1bHRzLnNlbmRfZW1haWxfZm9yX2ZsYWt5 X2ZhaWx1cmUpOiBNZXRob2QgdG8gc2VuZCBlbWFpbCBmb3IgZmxha3kgZmFpbHVyZS4KKyAgICAg ICAgKEFuYWx5emVMYXlvdXRUZXN0c1Jlc3VsdHMuc2VuZF9lbWFpbF9mb3JfcHJlX2V4aXN0aW5n X2ZhaWx1cmUpOiBNZXRob2QgdG8gc2VuZCBlbWFpbCBmb3IgcHJlLWV4aXN0aW5nIGZhaWx1cmUu CisgICAgICAgICogQnVpbGRTbGF2ZVN1cHBvcnQvZXdzLWJ1aWxkL3N0ZXBzLnB5OiBVcGRhdGVk IHVuaXQtdGVzdHMgYWNjb3JkaW5nbHkuCisgICAgICAgICogQnVpbGRTbGF2ZVN1cHBvcnQvZXdz LWJ1aWxkL3NlbmRfZW1haWwucHk6IEFkZGVkIGVycm9yIGhhbmRsaW5nLgorCiAyMDIwLTA3LTIz ICBYYWJpZXIgUm9kcmlndWV6IENhbHZhciAgPGNhbHZhcmlzQGlnYWxpYS5jb20+CiAKICAgICAg ICAgW0dTdHJlYW1lcl0gZ3N0X2J1ZmZlcl91bm1hcDogYXNzZXJ0aW9uICdHU1RfSVNfQlVGRkVS IChidWZmZXIpJyBmYWlsZWQKSW5kZXg6IFRvb2xzL0J1aWxkU2xhdmVTdXBwb3J0L2V3cy1idWls ZC9zZW5kX2VtYWlsLnB5Cj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIFRvb2xzL0J1aWxkU2xhdmVTdXBwb3J0L2V3 cy1idWlsZC9zZW5kX2VtYWlsLnB5CShyZXZpc2lvbiAyNjQ3NjIpCisrKyBUb29scy9CdWlsZFNs YXZlU3VwcG9ydC9ld3MtYnVpbGQvc2VuZF9lbWFpbC5weQkod29ya2luZyBjb3B5KQpAQCAtMjgs NiArMjgsMTMgQEAgU0VSVkVSID0gJ2xvY2FsaG9zdCcKIAogCiBkZWYgc2VuZF9lbWFpbCh0b19l bWFpbHMsIHN1YmplY3QsIHRleHQpOgorICAgIGlmIG5vdCB0b19lbWFpbHM6CisgICAgICAgIHBy aW50KCdTa2lwcGluZyBlbWFpbCBzaW5jZSBubyByZWNpcGllbnQgaXMgc3BlY2lmaWVkJykKKyAg ICAgICAgcmV0dXJuCisgICAgaWYgbm90IHN1YmplY3Qgb3Igbm90IHRleHQ6CisgICAgICAgIHBy aW50KCdTa2lwcGluZyBlbWFpbCBzaW5jZSBubyBzdWJqZWN0IG9yIHRleHQgaXMgc3BlY2lmaWVk JykKKyAgICAgICAgcmV0dXJuCisKICAgICBlbWFpbF9kYXRhID0gIiIiRnJvbToge31cblRvOiB7 fVxuU3ViamVjdDoge31cblxue30iIiIuZm9ybWF0KEZST01fRU1BSUwsICcsICcuam9pbih0b19l bWFpbHMpLCBzdWJqZWN0LCB0ZXh0KQogCiAgICAgc2VydmVyID0gc210cGxpYi5TTVRQKFNFUlZF UikKSW5kZXg6IFRvb2xzL0J1aWxkU2xhdmVTdXBwb3J0L2V3cy1idWlsZC9zdGVwcy5weQo9PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09Ci0tLSBUb29scy9CdWlsZFNsYXZlU3VwcG9ydC9ld3MtYnVpbGQvc3RlcHMucHkJKHJl dmlzaW9uIDI2NDc2MikKKysrIFRvb2xzL0J1aWxkU2xhdmVTdXBwb3J0L2V3cy1idWlsZC9zdGVw cy5weQkod29ya2luZyBjb3B5KQpAQCAtMjksNiArMjksNyBAQCBmcm9tIGJ1aWxkYm90LnN0ZXBz LndvcmtlciBpbXBvcnQgQ29tcG9zCiBmcm9tIHR3aXN0ZWQuaW50ZXJuZXQgaW1wb3J0IGRlZmVy CiAKIGZyb20gbGF5b3V0X3Rlc3RfZmFpbHVyZXMgaW1wb3J0IExheW91dFRlc3RGYWlsdXJlcwor ZnJvbSBzZW5kX2VtYWlsIGltcG9ydCBzZW5kX2VtYWlsX3RvX2JvdF93YXRjaGVycwogCiBpbXBv cnQganNvbgogaW1wb3J0IHJlCkBAIC0xODY2LDYgKzE4NjcsOCBAQCBjbGFzcyBSZVJ1bldlYktp dFRlc3RzKFJ1bldlYktpdFRlc3RzKToKICAgICAgICAgICAgICAgICBwbHVyYWxTdWZmaXggPSAn cycgaWYgbGVuKGZsYWt5X2ZhaWx1cmVzKSA+IDEgZWxzZSAnJwogICAgICAgICAgICAgICAgIG1l c3NhZ2UgPSAnRm91bmQgZmxha3kgdGVzdHt9OiB7fScuZm9ybWF0KHBsdXJhbFN1ZmZpeCwgZmxh a3lfZmFpbHVyZXNfc3RyaW5nKQogICAgICAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgnYnVpbGRf c3VtbWFyeScsIG1lc3NhZ2UpCisgICAgICAgICAgICBmb3IgZmxha3lfZmFpbHVyZSBpbiBmbGFr eV9mYWlsdXJlczoKKyAgICAgICAgICAgICAgICBzZWxmLnNlbmRfZW1haWxfZm9yX2ZsYWt5X2Zh aWx1cmUoZmxha3lfZmFpbHVyZSkKICAgICAgICAgZWxzZToKICAgICAgICAgICAgIHNlbGYuc2V0 UHJvcGVydHkoJ3BhdGNoRmFpbGVkVGVzdHMnLCBUcnVlKQogICAgICAgICAgICAgc2VsZi5idWls ZC5hZGRTdGVwc0FmdGVyQ3VycmVudFN0ZXAoW0FyY2hpdmVUZXN0UmVzdWx0cygpLApAQCAtMTg5 Myw2ICsxODk2LDE4IEBAIGNsYXNzIFJlUnVuV2ViS2l0VGVzdHMoUnVuV2ViS2l0VGVzdHMpOgog ICAgICAgICAgICAgICAgIHNlbGYuX2FkZFRvTG9nKHNlbGYudGVzdF9mYWlsdXJlc19sb2dfbmFt ZSwgJ1xuJy5qb2luKHNlY29uZF9yZXN1bHRzLmZhaWxpbmdfdGVzdHMpKQogICAgICAgICBzZWxm Ll9wYXJzZVJ1bldlYktpdFRlc3RzT3V0cHV0KGxvZ1RleHQpCiAKKyAgICBkZWYgc2VuZF9lbWFp bF9mb3JfZmxha3lfZmFpbHVyZShzZWxmLCB0ZXN0X25hbWUpOgorICAgICAgICB0cnk6CisgICAg ICAgICAgICBidWlsZGVyX25hbWUgPSBzZWxmLmdldFByb3BlcnR5KCdidWlsZGVybmFtZScsICcn KQorICAgICAgICAgICAgYnVpbGRfdXJsID0gJ3t9Iy9idWlsZGVycy97fS9idWlsZHMve30nLmZv cm1hdChzZWxmLm1hc3Rlci5jb25maWcuYnVpbGRib3RVUkwsIHNlbGYuYnVpbGQuX2J1aWxkZXJp ZCwgc2VsZi5idWlsZC5udW1iZXIpCisKKyAgICAgICAgICAgIGVtYWlsX3N1YmplY3QgPSAnRmxh a3kgdGVzdDoge30nLmZvcm1hdCh0ZXN0X25hbWUpCisgICAgICAgICAgICBlbWFpbF90ZXh0ID0g J1Rlc3Qge30gZmxha2VkIGluIHt9XG5cbkJ1aWxkZXI6IHt9Jy5mb3JtYXQodGVzdF9uYW1lLCBi dWlsZF91cmwsIGJ1aWxkZXJfbmFtZSkKKyAgICAgICAgICAgIHNlbmRfZW1haWxfdG9fYm90X3dh dGNoZXJzKGVtYWlsX3N1YmplY3QsIGVtYWlsX3RleHQpCisgICAgICAgIGV4Y2VwdCBFeGNlcHRp b24gYXMgZToKKyAgICAgICAgICAgICMgQ2F0Y2hpbmcgYWxsIGV4Y2VwdGlvbnMgaGVyZSB0byBl bnN1cmUgdGhhdCBmYWlsdXJlIHRvIHNlbmQgZW1haWwgZG9lc24ndCBpbXBhY3QgdGhlIGJ1aWxk CisgICAgICAgICAgICBwcmludCgnRXJyb3IgaW4gc2VuZGluZyBlbWFpbCBmb3IgZmxha3kgZmFp bHVyZXM6IHt9Jy5mb3JtYXQoZSkpCisKIAogY2xhc3MgUnVuV2ViS2l0VGVzdHNXaXRob3V0UGF0 Y2goUnVuV2ViS2l0VGVzdHMpOgogICAgIG5hbWUgPSAncnVuLWxheW91dC10ZXN0cy13aXRob3V0 LXBhdGNoJwpAQCAtMTk1MiwxMiArMTk2NywxOCBAQCBjbGFzcyBBbmFseXplTGF5b3V0VGVzdHNS ZXN1bHRzKGJ1aWxkc3RlCiAgICAgICAgICAgICBtZXNzYWdlID0gJ0ZvdW5kIHt9IHByZS1leGlz dGluZyB0ZXN0IGZhaWx1cmV7fToge30nLmZvcm1hdChsZW4oY2xlYW5fdHJlZV9mYWlsdXJlcyks IHBsdXJhbFN1ZmZpeCwgY2xlYW5fdHJlZV9mYWlsdXJlc19zdHJpbmcpCiAgICAgICAgICAgICBp ZiBsZW4oY2xlYW5fdHJlZV9mYWlsdXJlcykgPiBzZWxmLk5VTV9GQUlMVVJFU19UT19ESVNQTEFZ OgogICAgICAgICAgICAgICAgIG1lc3NhZ2UgKz0gJyAuLi4nCisgICAgICAgICAgICBmb3IgY2xl YW5fdHJlZV9mYWlsdXJlIGluIGNsZWFuX3RyZWVfZmFpbHVyZXM6CisgICAgICAgICAgICAgICAg c2VsZi5zZW5kX2VtYWlsX2Zvcl9wcmVfZXhpc3RpbmdfZmFpbHVyZShjbGVhbl90cmVlX2ZhaWx1 cmUpCisKICAgICAgICAgaWYgZmxha3lfZmFpbHVyZXM6CiAgICAgICAgICAgICBmbGFreV9mYWls dXJlc19zdHJpbmcgPSAnLCAnLmpvaW4oc29ydGVkKGZsYWt5X2ZhaWx1cmVzKVs6c2VsZi5OVU1f RkFJTFVSRVNfVE9fRElTUExBWV0pCiAgICAgICAgICAgICBwbHVyYWxTdWZmaXggPSAncycgaWYg bGVuKGZsYWt5X2ZhaWx1cmVzKSA+IDEgZWxzZSAnJwogICAgICAgICAgICAgbWVzc2FnZSArPSAn IEZvdW5kIGZsYWt5IHRlc3R7fToge30nLmZvcm1hdChwbHVyYWxTdWZmaXgsIGZsYWt5X2ZhaWx1 cmVzX3N0cmluZykKICAgICAgICAgICAgIGlmIGxlbihmbGFreV9mYWlsdXJlcykgPiBzZWxmLk5V TV9GQUlMVVJFU19UT19ESVNQTEFZOgogICAgICAgICAgICAgICAgIG1lc3NhZ2UgKz0gJyAuLi4n CisgICAgICAgICAgICBmb3IgZmxha3lfZmFpbHVyZSBpbiBmbGFreV9mYWlsdXJlczoKKyAgICAg ICAgICAgICAgICBzZWxmLnNlbmRfZW1haWxfZm9yX2ZsYWt5X2ZhaWx1cmUoZmxha3lfZmFpbHVy ZSkKKwogICAgICAgICBzZWxmLnNldFByb3BlcnR5KCdidWlsZF9zdW1tYXJ5JywgbWVzc2FnZSkK ICAgICAgICAgcmV0dXJuIGRlZmVyLnN1Y2NlZWQoTm9uZSkKIApAQCAtMTk3MSw2ICsxOTkyLDI4 IEBAIGNsYXNzIEFuYWx5emVMYXlvdXRUZXN0c1Jlc3VsdHMoYnVpbGRzdGUKICAgICBkZWYgX3Jl c3VsdHNfZmFpbGVkX2RpZmZlcmVudF90ZXN0cyhzZWxmLCBmaXJzdF9yZXN1bHRzX2ZhaWxpbmdf dGVzdHMsIHNlY29uZF9yZXN1bHRzX2ZhaWxpbmdfdGVzdHMpOgogICAgICAgICByZXR1cm4gZmly c3RfcmVzdWx0c19mYWlsaW5nX3Rlc3RzICE9IHNlY29uZF9yZXN1bHRzX2ZhaWxpbmdfdGVzdHMK IAorICAgIGRlZiBzZW5kX2VtYWlsX2Zvcl9mbGFreV9mYWlsdXJlKHNlbGYsIHRlc3RfbmFtZSk6 CisgICAgICAgIHRyeToKKyAgICAgICAgICAgIGJ1aWxkZXJfbmFtZSA9IHNlbGYuZ2V0UHJvcGVy dHkoJ2J1aWxkZXJuYW1lJywgJycpCisgICAgICAgICAgICBidWlsZF91cmwgPSAne30jL2J1aWxk ZXJzL3t9L2J1aWxkcy97fScuZm9ybWF0KHNlbGYubWFzdGVyLmNvbmZpZy5idWlsZGJvdFVSTCwg c2VsZi5idWlsZC5fYnVpbGRlcmlkLCBzZWxmLmJ1aWxkLm51bWJlcikKKworICAgICAgICAgICAg ZW1haWxfc3ViamVjdCA9ICdGbGFreSB0ZXN0OiB7fScuZm9ybWF0KHRlc3RfbmFtZSkKKyAgICAg ICAgICAgIGVtYWlsX3RleHQgPSAnVGVzdCB7fSBmbGFrZWQgaW4ge31cblxuQnVpbGRlcjoge30n LmZvcm1hdCh0ZXN0X25hbWUsIGJ1aWxkX3VybCwgYnVpbGRlcl9uYW1lKQorICAgICAgICAgICAg cmMgPSBzZW5kX2VtYWlsX3RvX2JvdF93YXRjaGVycyhlbWFpbF9zdWJqZWN0LCBlbWFpbF90ZXh0 KQorICAgICAgICBleGNlcHQgRXhjZXB0aW9uIGFzIGU6CisgICAgICAgICAgICBwcmludCgnRXJy b3IgaW4gc2VuZGluZyBlbWFpbCBmb3IgZmxha3kgZmFpbHVyZToge30nLmZvcm1hdChlKSkKKwor ICAgIGRlZiBzZW5kX2VtYWlsX2Zvcl9wcmVfZXhpc3RpbmdfZmFpbHVyZShzZWxmLCB0ZXN0X25h bWUpOgorICAgICAgICB0cnk6CisgICAgICAgICAgICBidWlsZGVyX25hbWUgPSBzZWxmLmdldFBy b3BlcnR5KCdidWlsZGVybmFtZScsICcnKQorICAgICAgICAgICAgYnVpbGRfdXJsID0gJ3t9Iy9i dWlsZGVycy97fS9idWlsZHMve30nLmZvcm1hdChzZWxmLm1hc3Rlci5jb25maWcuYnVpbGRib3RV UkwsIHNlbGYuYnVpbGQuX2J1aWxkZXJpZCwgc2VsZi5idWlsZC5udW1iZXIpCisKKyAgICAgICAg ICAgIGVtYWlsX3N1YmplY3QgPSAnUHJlLWV4aXN0aW5nIHRlc3QgZmFpbHVyZToge30nLmZvcm1h dCh0ZXN0X25hbWUpCisgICAgICAgICAgICBlbWFpbF90ZXh0ID0gJ1Rlc3Qge30gZmFpbGVkIG9u IGNsZWFuIHRyZWUgcnVuIGluIHt9LlxuQnVpbGRlcjoge30nLmZvcm1hdCh0ZXN0X25hbWUsIGJ1 aWxkX3VybCwgYnVpbGRlcl9uYW1lKQorICAgICAgICAgICAgcmMgPSBzZW5kX2VtYWlsX3RvX2Jv dF93YXRjaGVycyhlbWFpbF9zdWJqZWN0LCBlbWFpbF90ZXh0KQorICAgICAgICBleGNlcHQgRXhj ZXB0aW9uIGFzIGU6CisgICAgICAgICAgICBwcmludCgnRXJyb3IgaW4gc2VuZGluZyBlbWFpbCBm b3IgcHJlLWV4aXN0aW5nIGZhaWx1cmU6IHt9Jy5mb3JtYXQoZSkpCisKICAgICBkZWYgX3JlcG9y dF9mbGFreV90ZXN0cyhzZWxmLCBmbGFreV90ZXN0cyk6CiAgICAgICAgICNUT0RPOiBpbXBsZW1l bnQgdGhpcwogICAgICAgICBwYXNzCkluZGV4OiBUb29scy9CdWlsZFNsYXZlU3VwcG9ydC9ld3Mt YnVpbGQvc3RlcHNfdW5pdHRlc3QucHkKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PQotLS0gVG9vbHMvQnVpbGRTbGF2ZVN1 cHBvcnQvZXdzLWJ1aWxkL3N0ZXBzX3VuaXR0ZXN0LnB5CShyZXZpc2lvbiAyNjQ3NjIpCisrKyBU b29scy9CdWlsZFNsYXZlU3VwcG9ydC9ld3MtYnVpbGQvc3RlcHNfdW5pdHRlc3QucHkJKHdvcmtp bmcgY29weSkKQEAgLTUyLDYgKzUyLDkgQEAgZnJvbSBzdGVwcyBpbXBvcnQgKEFuYWx5emVBUElU ZXN0c1Jlc3VsdAogICAgICAgICAgICAgICAgICAgIFRyaWdnZXIsIFRyYW5zZmVyVG9TMywgVW5B cHBseVBhdGNoSWZSZXF1aXJlZCwgVXBkYXRlV29ya2luZ0RpcmVjdG9yeSwgVXBsb2FkQnVpbHRQ cm9kdWN0LAogICAgICAgICAgICAgICAgICAgIFVwbG9hZFRlc3RSZXN1bHRzLCBWYWxpZGF0ZUNv bW1pdGVyQW5kUmV2aWV3ZXIsIFZhbGlkYXRlUGF0Y2gpCiAKK2ltcG9ydCBzZW5kX2VtYWlsCitz ZW5kX2VtYWlsLkJPVF9XQVRDSEVSU19FTUFJTFMgPSBbXQorCiAjIFdvcmthcm91bmQgZm9yIGh0 dHBzOi8vZ2l0aHViLmNvbS9idWlsZGJvdC9idWlsZGJvdC9pc3N1ZXMvNDY2OQogZnJvbSBidWls ZGJvdC50ZXN0LmZha2UuZmFrZWJ1aWxkIGltcG9ydCBGYWtlQnVpbGQKIEZha2VCdWlsZC5hZGRT dGVwc0FmdGVyQ3VycmVudFN0ZXAgPSBsYW1iZGEgRmFrZUJ1aWxkLCBzdGVwX2ZhY3Rvcmllczog Tm9uZQpAQCAtMTczNyw2ICsxNzQwLDI1IEBAIGNsYXNzIFRlc3RSZVJ1bldlYktpdFRlc3RzKFRl c3RSdW5XZWJLaXQKICAgICAgICAgc2VsZi5zZXR1cFN0ZXAoUmVSdW5XZWJLaXRUZXN0cygpKQog ICAgICAgICBzZWxmLnByb3BlcnR5X2V4Y2VlZF9mYWlsdXJlX2xpbWl0ID0gJ3NlY29uZF9yZXN1 bHRzX2V4Y2VlZF9mYWlsdXJlX2xpbWl0JwogICAgICAgICBzZWxmLnByb3BlcnR5X2ZhaWx1cmVz ID0gJ3NlY29uZF9ydW5fZmFpbHVyZXMnCisgICAgICAgIFJlUnVuV2ViS2l0VGVzdHMuc2VuZF9l bWFpbF9mb3JfZmxha3lfZmFpbHVyZSA9IGxhbWJkYSBzdWJqZWN0LCB0ZXN0OiBOb25lCisKKyAg ICBkZWYgdGVzdF9mbGFreV9mYWlsdXJlc19pbl9maXJzdF9ydW4oc2VsZik6CisgICAgICAgIHNl bGYuY29uZmlndXJlU3RlcCgpCisgICAgICAgIHNlbGYuc2V0UHJvcGVydHkoJ2Z1bGxQbGF0Zm9y bScsICdpb3Mtc2ltdWxhdG9yJykKKyAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgnY29uZmlndXJh dGlvbicsICdyZWxlYXNlJykKKyAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgnZmlyc3RfcnVuX2Zh aWx1cmVzJywgWyd0ZXN0MScsICd0ZXN0MiddKQorICAgICAgICBzZWxmLmV4cGVjdFJlbW90ZUNv bW1hbmRzKAorICAgICAgICAgICAgRXhwZWN0U2hlbGwod29ya2Rpcj0nd2tkaXInLAorICAgICAg ICAgICAgICAgICAgICAgICAgbG9nZmlsZXM9eydqc29uJzogc2VsZi5qc29uRmlsZU5hbWV9LAor ICAgICAgICAgICAgICAgICAgICAgICAgbG9nRW52aXJvbj1GYWxzZSwKKyAgICAgICAgICAgICAg ICAgICAgICAgIGNvbW1hbmQ9WydweXRob24nLCAnVG9vbHMvU2NyaXB0cy9ydW4td2Via2l0LXRl c3RzJywgJy0tbm8tYnVpbGQnLCAnLS1uby1zaG93LXJlc3VsdHMnLCAnLS1uby1uZXctdGVzdC1y ZXN1bHRzJywgJy0tY2xvYmJlci1vbGQtcmVzdWx0cycsICctLXJlbGVhc2UnLCAnLS1yZXN1bHRz LWRpcmVjdG9yeScsICdsYXlvdXQtdGVzdC1yZXN1bHRzJywgJy0tZGVidWctcnd0LWxvZ2dpbmcn LCAnLS1leGl0LWFmdGVyLW4tZmFpbHVyZXMnLCAnMzAnLCAnLS1za2lwLWZhaWxpbmctdGVzdHMn XSwKKyAgICAgICAgICAgICAgICAgICAgICAgICkKKyAgICAgICAgICAgICsgMCwKKyAgICAgICAg KQorICAgICAgICBzZWxmLmV4cGVjdE91dGNvbWUocmVzdWx0PVNVQ0NFU1MsIHN0YXRlX3N0cmlu Zz0nUGFzc2VkIGxheW91dCB0ZXN0cycpCisgICAgICAgIHJjID0gc2VsZi5ydW5TdGVwKCkKKyAg ICAgICAgc2VsZi5hc3NlcnRFcXVhbChzZWxmLmdldFByb3BlcnR5KCdidWlsZF9zdW1tYXJ5Jyks ICdGb3VuZCBmbGFreSB0ZXN0czogdGVzdDEsIHRlc3QyJykKKyAgICAgICAgcmV0dXJuIHJjCiAK IAogY2xhc3MgVGVzdFJ1bldlYktpdFRlc3RzV2l0aG91dFBhdGNoKEJ1aWxkU3RlcE1peGluQWRk aXRpb25zLCB1bml0dGVzdC5UZXN0Q2FzZSk6CkBAIC0xODY3LDYgKzE4ODksOCBAQCBjbGFzcyBU ZXN0QW5hbHl6ZUxheW91dFRlc3RzUmVzdWx0cyhCdWlsCiAgICAgICAgIHJldHVybiBzZWxmLnRl YXJEb3duQnVpbGRTdGVwKCkKIAogICAgIGRlZiBjb25maWd1cmVTdGVwKHNlbGYpOgorICAgICAg ICBBbmFseXplTGF5b3V0VGVzdHNSZXN1bHRzLnNlbmRfZW1haWxfZm9yX2ZsYWt5X2ZhaWx1cmUg PSBsYW1iZGEgc3ViamVjdCwgdGVzdDogTm9uZQorICAgICAgICBBbmFseXplTGF5b3V0VGVzdHNS ZXN1bHRzLnNlbmRfZW1haWxfZm9yX3ByZV9leGlzdGluZ19mYWlsdXJlID0gbGFtYmRhIHN1Ympl Y3QsIHRlc3Q6IE5vbmUKICAgICAgICAgc2VsZi5zZXR1cFN0ZXAoQW5hbHl6ZUxheW91dFRlc3Rz UmVzdWx0cygpKQogICAgICAgICBzZWxmLnNldFByb3BlcnR5KCdmaXJzdF9yZXN1bHRzX2V4Y2Vl ZF9mYWlsdXJlX2xpbWl0JywgRmFsc2UpCiAgICAgICAgIHNlbGYuc2V0UHJvcGVydHkoJ3NlY29u ZF9yZXN1bHRzX2V4Y2VlZF9mYWlsdXJlX2xpbWl0JywgRmFsc2UpCg==