226097 2021-05-21 11:49:58 -0700 Run layout tests in stress mode for 10 iterations on regular EWS layout-test queues 2021-05-26 08:27:14 -0700 1 1 1 Unclassified WebKit Tools / Tests Other Unspecified Unspecified RESOLVED FIXED https://bugs.webkit.org/show_bug.cgi?id=226273 InRadar P2 Normal --- 1 aakash_jain aakash_jain ap ddkilzer hi jbedard ryanhaddad webkit-bug-importer oldest_to_newest 1762503 0 aakash_jain 2021-05-21 11:49:58 -0700 Stress mode for layout-test was added as a stand-alone queue in https://lists.webkit.org/pipermail/webkit-dev/2021-April/031773.html Running for 100 iterations sometimes takes long time for certain patches. However we should run the tests being added/modified for limited iterations (e.g.: 10) on regular EWS layout-test queues. This would provide following benefit: 1) some coverage for stress test on multiple platforms 2) early indication of issues (since running 10 iterations of layout-tests being added/modified is usually quick), before running the complete layout-test suite. 1762504 1 429317 aakash_jain 2021-05-21 11:51:29 -0700 Created attachment 429317 Patch 1762524 2 aakash_jain 2021-05-21 12:45:01 -0700 Sample runs: https://ews-build.webkit-uat.org/#/builders/34/builds/31233 (on patch which modify layout-test) https://ews-build.webkit-uat.org/#/builders/34/builds/31254 (on patch which doesn't modify layout-test) 1762555 3 429317 jbedard 2021-05-21 13:24:28 -0700 Comment on attachment 429317 Patch View in context: https://bugs.webkit.org/attachment.cgi?id=429317&action=review > Tools/CISupport/ews-build/steps_unittest.py:1947 > + '--iterations', 100, 'test1', 'test2'], I'm a bit unclear why anything as changed here. 1762556 4 429317 jbedard 2021-05-21 13:27:06 -0700 Comment on attachment 429317 Patch View in context: https://bugs.webkit.org/attachment.cgi?id=429317&action=review >> Tools/CISupport/ews-build/steps_unittest.py:1947 >> + '--iterations', 100, 'test1', 'test2'], > > I'm a bit unclear why anything as changed here. oh! Because you added the "modified_tests" property, got it. 1762558 5 aakash_jain 2021-05-21 13:28:12 -0700 Yeah. This should have been there in the first place. But adding the 'doStepIf' in this patch (based on modified_tests) makes it required now. 1762569 6 ews-feeder 2021-05-21 13:58:11 -0700 Committed r277884 (238021@main): <https://commits.webkit.org/238021@main> All reviewed patches have been landed. Closing bug and clearing flags on attachment 429317. 1762570 7 webkit-bug-importer 2021-05-21 13:59:19 -0700 <rdar://problem/78327180> 1762800 8 aakash_jain 2021-05-22 04:32:11 -0700 Restarted EWS to pick up this change. 1763570 9 aakash_jain 2021-05-25 10:39:47 -0700 This change seems to be working fine. e.g.: Patch which doesn't modify layout-test: https://ews-build.webkit.org/#/builders/51/builds/14126 Patch which add/modify layout-tests and passes: https://ews-build.webkit.org/#/builders/51/builds/14125 Patch which add/modify layout-tests and introduce failure: https://ews-build.webkit.org/#/builders/51/builds/14098 429317 2021-05-21 11:51:29 -0700 2021-05-21 13:58:11 -0700 Patch bug-226097-20210521145128.patch text/plain 14471 aakash_jain SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl dmlzaW9uIDI3Nzg3MikKKysrIFRvb2xzL0NoYW5nZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwz ICsxLDIyIEBACisyMDIxLTA1LTIxICBBYWthc2ggSmFpbiAgPGFha2FzaF9qYWluQGFwcGxlLmNv bT4KKworICAgICAgICBSdW4gbGF5b3V0IHRlc3RzIGluIHN0cmVzcyBtb2RlIGZvciAxMCBpdGVy YXRpb25zIG9uIHJlZ3VsYXIgRVdTIGxheW91dC10ZXN0IHF1ZXVlcworICAgICAgICBodHRwczov L2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9MjI2MDk3CisKKyAgICAgICAgUmV2aWV3 ZWQgYnkgTk9CT0RZIChPT1BTISkuCisKKyAgICAgICAgKiBDSVN1cHBvcnQvZXdzLWJ1aWxkL2Zh Y3Rvcmllcy5weToKKyAgICAgICAgKiBDSVN1cHBvcnQvZXdzLWJ1aWxkL2ZhY3Rvcmllc191bml0 dGVzdC5weToKKyAgICAgICAgKiBDSVN1cHBvcnQvZXdzLWJ1aWxkL3N0ZXBzLnB5OgorICAgICAg ICAoQW5hbHl6ZVBhdGNoLmdldFJlc3VsdFN1bW1hcnkpOgorICAgICAgICAoRmluZE1vZGlmaWVk TGF5b3V0VGVzdHMuX19pbml0X18pOgorICAgICAgICAoRmluZE1vZGlmaWVkTGF5b3V0VGVzdHMu c3RhcnQpOgorICAgICAgICAoUnVuV2ViS2l0VGVzdHNJblN0cmVzc01vZGUpOgorICAgICAgICAo UnVuV2ViS2l0VGVzdHNJblN0cmVzc01vZGUuX19pbml0X18pOgorICAgICAgICAoUnVuV2ViS2l0 VGVzdHNJblN0cmVzc01vZGUuc2V0TGF5b3V0VGVzdENvbW1hbmQpOgorICAgICAgICAoUnVuV2Vi S2l0VGVzdHNJblN0cmVzc01vZGUuZG9TdGVwSWYpOgorICAgICAgICAqIENJU3VwcG9ydC9ld3Mt YnVpbGQvc3RlcHNfdW5pdHRlc3QucHk6CisKIDIwMjEtMDUtMjEgIFNhbSBTbmVkZG9uICA8Z3Nu ZWRkZXJzQGFwcGxlLmNvbT4KIAogICAgICAgICBGaXggUHl0aG9uIDMuNisgRGVwcmVjYXRpb25X YXJuaW5ncyBhYm91dCB1bmtub3duIGVzY2FwZXMKSW5kZXg6IFRvb2xzL0NJU3VwcG9ydC9ld3Mt YnVpbGQvZmFjdG9yaWVzLnB5Cj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIFRvb2xzL0NJU3VwcG9ydC9ld3MtYnVp bGQvZmFjdG9yaWVzLnB5CShyZXZpc2lvbiAyNzc4NzIpCisrKyBUb29scy9DSVN1cHBvcnQvZXdz LWJ1aWxkL2ZhY3Rvcmllcy5weQkod29ya2luZyBjb3B5KQpAQCAtMTM0LDYgKzEzNCw4IEBAIGNs YXNzIFRlc3RGYWN0b3J5KEZhY3RvcnkpOgogICAgICAgICAgICAgc2VsZi5hZGRTdGVwKFdhaXRG b3JDcmFzaENvbGxlY3Rpb24oKSkKICAgICAgICAgc2VsZi5hZGRTdGVwKEtpbGxPbGRQcm9jZXNz ZXMoKSkKICAgICAgICAgaWYgc2VsZi5MYXlvdXRUZXN0Q2xhc3M6CisgICAgICAgICAgICBzZWxm LmFkZFN0ZXAoRmluZE1vZGlmaWVkTGF5b3V0VGVzdHMoc2tpcEJ1aWxkSWZOb1Jlc3VsdD1GYWxz ZSkpCisgICAgICAgICAgICBzZWxmLmFkZFN0ZXAoUnVuV2ViS2l0VGVzdHNJblN0cmVzc01vZGUo bnVtX2l0ZXJhdGlvbnM9MTApKQogICAgICAgICAgICAgc2VsZi5hZGRTdGVwKHNlbGYuTGF5b3V0 VGVzdENsYXNzKCkpCiAgICAgICAgIGlmIHNlbGYuQVBJVGVzdENsYXNzOgogICAgICAgICAgICAg c2VsZi5hZGRTdGVwKHNlbGYuQVBJVGVzdENsYXNzKCkpCkluZGV4OiBUb29scy9DSVN1cHBvcnQv ZXdzLWJ1aWxkL2ZhY3Rvcmllc191bml0dGVzdC5weQo9PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DSVN1 cHBvcnQvZXdzLWJ1aWxkL2ZhY3Rvcmllc191bml0dGVzdC5weQkocmV2aXNpb24gMjc3ODcyKQor KysgVG9vbHMvQ0lTdXBwb3J0L2V3cy1idWlsZC9mYWN0b3JpZXNfdW5pdHRlc3QucHkJKHdvcmtp bmcgY29weSkKQEAgLTQ1Niw2ICs0NTYsOCBAQCBjbGFzcyBUZXN0TGF5b3V0VGVzdHNGYWN0b3J5 KFRlc3RDYXNlKToKICAgICAgICAgICAgIF9CdWlsZFN0ZXBGYWN0b3J5KHN0ZXBzLkV4dHJhY3RC dWlsdFByb2R1Y3QpLAogICAgICAgICAgICAgX0J1aWxkU3RlcEZhY3Rvcnkoc3RlcHMuV2FpdEZv ckNyYXNoQ29sbGVjdGlvbiksCiAgICAgICAgICAgICBfQnVpbGRTdGVwRmFjdG9yeShzdGVwcy5L aWxsT2xkUHJvY2Vzc2VzKSwKKyAgICAgICAgICAgIF9CdWlsZFN0ZXBGYWN0b3J5KHN0ZXBzLkZp bmRNb2RpZmllZExheW91dFRlc3RzLCBza2lwQnVpbGRJZk5vUmVzdWx0PUZhbHNlKSwKKyAgICAg ICAgICAgIF9CdWlsZFN0ZXBGYWN0b3J5KHN0ZXBzLlJ1bldlYktpdFRlc3RzSW5TdHJlc3NNb2Rl LCBudW1faXRlcmF0aW9ucz0xMCksCiAgICAgICAgICAgICBfQnVpbGRTdGVwRmFjdG9yeShzdGVw cy5SdW5XZWJLaXQxVGVzdHMpLAogICAgICAgICAgICAgX0J1aWxkU3RlcEZhY3Rvcnkoc3RlcHMu VHJpZ2dlckNyYXNoTG9nU3VibWlzc2lvbiksCiAgICAgICAgICAgICBfQnVpbGRTdGVwRmFjdG9y eShzdGVwcy5TZXRCdWlsZFN1bW1hcnkpLApAQCAtNDc4LDYgKzQ4MCw4IEBAIGNsYXNzIFRlc3RM YXlvdXRUZXN0c0ZhY3RvcnkoVGVzdENhc2UpOgogICAgICAgICAgICAgX0J1aWxkU3RlcEZhY3Rv cnkoc3RlcHMuRXh0cmFjdEJ1aWx0UHJvZHVjdCksCiAgICAgICAgICAgICBfQnVpbGRTdGVwRmFj dG9yeShzdGVwcy5XYWl0Rm9yQ3Jhc2hDb2xsZWN0aW9uKSwKICAgICAgICAgICAgIF9CdWlsZFN0 ZXBGYWN0b3J5KHN0ZXBzLktpbGxPbGRQcm9jZXNzZXMpLAorICAgICAgICAgICAgX0J1aWxkU3Rl cEZhY3Rvcnkoc3RlcHMuRmluZE1vZGlmaWVkTGF5b3V0VGVzdHMsIHNraXBCdWlsZElmTm9SZXN1 bHQ9RmFsc2UpLAorICAgICAgICAgICAgX0J1aWxkU3RlcEZhY3Rvcnkoc3RlcHMuUnVuV2ViS2l0 VGVzdHNJblN0cmVzc01vZGUsIG51bV9pdGVyYXRpb25zPTEwKSwKICAgICAgICAgICAgIF9CdWls ZFN0ZXBGYWN0b3J5KHN0ZXBzLlJ1bldlYktpdDFUZXN0cyksCiAgICAgICAgICAgICBfQnVpbGRT dGVwRmFjdG9yeShzdGVwcy5UcmlnZ2VyQ3Jhc2hMb2dTdWJtaXNzaW9uKSwKICAgICAgICAgICAg IF9CdWlsZFN0ZXBGYWN0b3J5KHN0ZXBzLlNldEJ1aWxkU3VtbWFyeSksCkBAIC00OTksNiArNTAz LDggQEAgY2xhc3MgVGVzdExheW91dFRlc3RzRmFjdG9yeShUZXN0Q2FzZSk6CiAgICAgICAgICAg ICBfQnVpbGRTdGVwRmFjdG9yeShzdGVwcy5FeHRyYWN0QnVpbHRQcm9kdWN0KSwKICAgICAgICAg ICAgIF9CdWlsZFN0ZXBGYWN0b3J5KHN0ZXBzLldhaXRGb3JDcmFzaENvbGxlY3Rpb24pLAogICAg ICAgICAgICAgX0J1aWxkU3RlcEZhY3Rvcnkoc3RlcHMuS2lsbE9sZFByb2Nlc3NlcyksCisgICAg ICAgICAgICBfQnVpbGRTdGVwRmFjdG9yeShzdGVwcy5GaW5kTW9kaWZpZWRMYXlvdXRUZXN0cywg c2tpcEJ1aWxkSWZOb1Jlc3VsdD1GYWxzZSksCisgICAgICAgICAgICBfQnVpbGRTdGVwRmFjdG9y eShzdGVwcy5SdW5XZWJLaXRUZXN0c0luU3RyZXNzTW9kZSwgbnVtX2l0ZXJhdGlvbnM9MTApLAog ICAgICAgICAgICAgX0J1aWxkU3RlcEZhY3Rvcnkoc3RlcHMuUnVuV2ViS2l0VGVzdHMpLAogICAg ICAgICAgICAgX0J1aWxkU3RlcEZhY3Rvcnkoc3RlcHMuVHJpZ2dlckNyYXNoTG9nU3VibWlzc2lv biksCiAgICAgICAgICAgICBfQnVpbGRTdGVwRmFjdG9yeShzdGVwcy5TZXRCdWlsZFN1bW1hcnkp LApAQCAtNTIwLDYgKzUyNiw4IEBAIGNsYXNzIFRlc3RMYXlvdXRUZXN0c0ZhY3RvcnkoVGVzdENh c2UpOgogICAgICAgICAgICAgX0J1aWxkU3RlcEZhY3Rvcnkoc3RlcHMuRXh0cmFjdEJ1aWx0UHJv ZHVjdCksCiAgICAgICAgICAgICBfQnVpbGRTdGVwRmFjdG9yeShzdGVwcy5XYWl0Rm9yQ3Jhc2hD b2xsZWN0aW9uKSwKICAgICAgICAgICAgIF9CdWlsZFN0ZXBGYWN0b3J5KHN0ZXBzLktpbGxPbGRQ cm9jZXNzZXMpLAorICAgICAgICAgICAgX0J1aWxkU3RlcEZhY3Rvcnkoc3RlcHMuRmluZE1vZGlm aWVkTGF5b3V0VGVzdHMsIHNraXBCdWlsZElmTm9SZXN1bHQ9RmFsc2UpLAorICAgICAgICAgICAg X0J1aWxkU3RlcEZhY3Rvcnkoc3RlcHMuUnVuV2ViS2l0VGVzdHNJblN0cmVzc01vZGUsIG51bV9p dGVyYXRpb25zPTEwKSwKICAgICAgICAgICAgIF9CdWlsZFN0ZXBGYWN0b3J5KHN0ZXBzLlJ1bldl YktpdFRlc3RzKSwKICAgICAgICAgICAgIF9CdWlsZFN0ZXBGYWN0b3J5KHN0ZXBzLlRyaWdnZXJD cmFzaExvZ1N1Ym1pc3Npb24pLAogICAgICAgICAgICAgX0J1aWxkU3RlcEZhY3Rvcnkoc3RlcHMu U2V0QnVpbGRTdW1tYXJ5KSwKQEAgLTU0MSw2ICs1NDksOCBAQCBjbGFzcyBUZXN0TGF5b3V0VGVz dHNGYWN0b3J5KFRlc3RDYXNlKToKICAgICAgICAgICAgIF9CdWlsZFN0ZXBGYWN0b3J5KHN0ZXBz LkRvd25sb2FkQnVpbHRQcm9kdWN0KSwKICAgICAgICAgICAgIF9CdWlsZFN0ZXBGYWN0b3J5KHN0 ZXBzLkV4dHJhY3RCdWlsdFByb2R1Y3QpLAogICAgICAgICAgICAgX0J1aWxkU3RlcEZhY3Rvcnko c3RlcHMuS2lsbE9sZFByb2Nlc3NlcyksCisgICAgICAgICAgICBfQnVpbGRTdGVwRmFjdG9yeShz dGVwcy5GaW5kTW9kaWZpZWRMYXlvdXRUZXN0cywgc2tpcEJ1aWxkSWZOb1Jlc3VsdD1GYWxzZSks CisgICAgICAgICAgICBfQnVpbGRTdGVwRmFjdG9yeShzdGVwcy5SdW5XZWJLaXRUZXN0c0luU3Ry ZXNzTW9kZSwgbnVtX2l0ZXJhdGlvbnM9MTApLAogICAgICAgICAgICAgX0J1aWxkU3RlcEZhY3Rv cnkoc3RlcHMuUnVuV2ViS2l0VGVzdHMpLAogICAgICAgICAgICAgX0J1aWxkU3RlcEZhY3Rvcnko c3RlcHMuU2V0QnVpbGRTdW1tYXJ5KSwKICAgICAgICAgXSkKSW5kZXg6IFRvb2xzL0NJU3VwcG9y dC9ld3MtYnVpbGQvc3RlcHMucHkKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PQotLS0gVG9vbHMvQ0lTdXBwb3J0L2V3cy1i dWlsZC9zdGVwcy5weQkocmV2aXNpb24gMjc3ODcyKQorKysgVG9vbHMvQ0lTdXBwb3J0L2V3cy1i dWlsZC9zdGVwcy5weQkod29ya2luZyBjb3B5KQpAQCAtMzY5LDcgKzM2OSw3IEBAIGNsYXNzIEFu YWx5emVQYXRjaChidWlsZHN0ZXAuQnVpbGRTdGVwKToKICAgICAgICAgbG9nLmFkZFN0ZG91dCht ZXNzYWdlKQogCiAgICAgZGVmIGdldFJlc3VsdFN1bW1hcnkoc2VsZik6Ci0gICAgICAgIGlmIHNl bGYucmVzdWx0cyA9PSBGQUlMVVJFOgorICAgICAgICBpZiBzZWxmLnJlc3VsdHMgaW4gW0ZBSUxV UkUsIFNLSVBQRURdOgogICAgICAgICAgICAgcmV0dXJuIHsnc3RlcCc6ICdQYXRjaCBkb2Vzblwn dCBoYXZlIHJlbGV2YW50IGNoYW5nZXMnfQogICAgICAgICBpZiBzZWxmLnJlc3VsdHMgPT0gU1VD Q0VTUzoKICAgICAgICAgICAgIHJldHVybiB7J3N0ZXAnOiAnUGF0Y2ggY29udGFpbnMgcmVsZXZh bnQgY2hhbmdlcyd9CkBAIC00ODMsNiArNDgzLDEwIEBAIGNsYXNzIEZpbmRNb2RpZmllZExheW91 dFRlc3RzKEFuYWx5emVQYXQKICAgICBESVJFQ1RPUklFU19UT19JR05PUkUgPSBbJ3JlZmVyZW5j ZScsICdyZWZ0ZXN0JywgJ3Jlc291cmNlcycsICdzdXBwb3J0JywgJ3NjcmlwdC10ZXN0cycsICd0 b29scyddCiAgICAgU1VGRklYRVNfVE9fSUdOT1JFID0gWyctZXhwZWN0ZWQnLCAnLWV4cGVjdGVk LW1pc21hdGNoJywgJy1yZWYnLCAnLW5vdHJlZiddCiAKKyAgICBkZWYgX19pbml0X18oc2VsZiwg c2tpcEJ1aWxkSWZOb1Jlc3VsdD1UcnVlKToKKyAgICAgICAgc2VsZi5za2lwQnVpbGRJZk5vUmVz dWx0ID0gc2tpcEJ1aWxkSWZOb1Jlc3VsdAorICAgICAgICBidWlsZHN0ZXAuQnVpbGRTdGVwLl9f aW5pdF9fKHNlbGYpCisKICAgICBkZWYgZmluZF90ZXN0X25hbWVzX2Zyb21fcGF0Y2goc2VsZiwg cGF0Y2gpOgogICAgICAgICB0ZXN0cyA9IFtdCiAgICAgICAgIGZvciBsaW5lIGluIHBhdGNoLnNw bGl0bGluZXMoKToKQEAgLTUxMSw5ICs1MTUsMTAgQEAgY2xhc3MgRmluZE1vZGlmaWVkTGF5b3V0 VGVzdHMoQW5hbHl6ZVBhdAogICAgICAgICAgICAgcmV0dXJuIE5vbmUKIAogICAgICAgICBzZWxm Ll9hZGRUb0xvZygnc3RkaW8nLCAnVGhpcyBwYXRjaCBkb2VzIG5vdCBtb2RpZnkgYW55IGxheW91 dCB0ZXN0cycpCi0gICAgICAgIHNlbGYuZmluaXNoZWQoRkFJTFVSRSkKLSAgICAgICAgc2VsZi5i dWlsZC5yZXN1bHRzID0gU0tJUFBFRAotICAgICAgICBzZWxmLmJ1aWxkLmJ1aWxkRmluaXNoZWQo WydQYXRjaCB7fSBkb2VzblwndCBoYXZlIHJlbGV2YW50IGNoYW5nZXMnLmZvcm1hdChzZWxmLmdl dFByb3BlcnR5KCdwYXRjaF9pZCcsICcnKSldLCBTS0lQUEVEKQorICAgICAgICBzZWxmLmZpbmlz aGVkKFNLSVBQRUQpCisgICAgICAgIGlmIHNlbGYuc2tpcEJ1aWxkSWZOb1Jlc3VsdDoKKyAgICAg ICAgICAgIHNlbGYuYnVpbGQucmVzdWx0cyA9IFNLSVBQRUQKKyAgICAgICAgICAgIHNlbGYuYnVp bGQuYnVpbGRGaW5pc2hlZChbJ1BhdGNoIHt9IGRvZXNuXCd0IGhhdmUgcmVsZXZhbnQgY2hhbmdl cycuZm9ybWF0KHNlbGYuZ2V0UHJvcGVydHkoJ3BhdGNoX2lkJywgJycpKV0sIFNLSVBQRUQpCiAg ICAgICAgIHJldHVybiBOb25lCiAKIApAQCAtMjI4OCwxMiArMjI5MywxNSBAQCBjbGFzcyBSdW5X ZWJLaXRUZXN0c0luU3RyZXNzTW9kZShSdW5XZWJLCiAgICAgbmFtZSA9ICdydW4tbGF5b3V0LXRl c3RzLWluLXN0cmVzcy1tb2RlJwogICAgIHN1ZmZpeCA9ICdzdHJlc3MtbW9kZScKICAgICBFWElU X0FGVEVSX0ZBSUxVUkVTID0gJzEwJwotICAgIE5VTV9JVEVSQVRJT05TID0gMTAwCisKKyAgICBk ZWYgX19pbml0X18oc2VsZiwgbnVtX2l0ZXJhdGlvbnM9MTAwKToKKyAgICAgICAgc2VsZi5udW1f aXRlcmF0aW9ucyA9IG51bV9pdGVyYXRpb25zCisgICAgICAgIHN1cGVyKFJ1bldlYktpdFRlc3Rz SW5TdHJlc3NNb2RlLCBzZWxmKS5fX2luaXRfXygpCiAKICAgICBkZWYgc2V0TGF5b3V0VGVzdENv bW1hbmQoc2VsZik6CiAgICAgICAgIFJ1bldlYktpdFRlc3RzLnNldExheW91dFRlc3RDb21tYW5k KHNlbGYpCiAKLSAgICAgICAgc2VsZi5zZXRDb21tYW5kKHNlbGYuY29tbWFuZCArIFsnLS1pdGVy YXRpb25zJywgc2VsZi5OVU1fSVRFUkFUSU9OU10pCisgICAgICAgIHNlbGYuc2V0Q29tbWFuZChz ZWxmLmNvbW1hbmQgKyBbJy0taXRlcmF0aW9ucycsIHNlbGYubnVtX2l0ZXJhdGlvbnNdKQogICAg ICAgICBtb2RpZmllZF90ZXN0cyA9IHNlbGYuZ2V0UHJvcGVydHkoJ21vZGlmaWVkX3Rlc3RzJykK ICAgICAgICAgaWYgbW9kaWZpZWRfdGVzdHM6CiAgICAgICAgICAgICBzZWxmLnNldENvbW1hbmQo c2VsZi5jb21tYW5kICsgbW9kaWZpZWRfdGVzdHMpCkBAIC0yMzE0LDYgKzIzMjIsOSBAQCBjbGFz cyBSdW5XZWJLaXRUZXN0c0luU3RyZXNzTW9kZShSdW5XZWJLCiAgICAgICAgICAgICBdKQogICAg ICAgICByZXR1cm4gcmMKIAorICAgIGRlZiBkb1N0ZXBJZihzZWxmLCBzdGVwKToKKyAgICAgICAg cmV0dXJuIHNlbGYuZ2V0UHJvcGVydHkoJ21vZGlmaWVkX3Rlc3RzJywgRmFsc2UpCisKIAogY2xh c3MgUnVuV2ViS2l0VGVzdHNJblN0cmVzc0d1YXJkbWFsbG9jTW9kZShSdW5XZWJLaXRUZXN0c0lu U3RyZXNzTW9kZSk6CiAgICAgbmFtZSA9ICdydW4tbGF5b3V0LXRlc3RzLWluLWd1YXJkLW1hbGxv Yy1zdHJlc3MtbW9kZScKSW5kZXg6IFRvb2xzL0NJU3VwcG9ydC9ld3MtYnVpbGQvc3RlcHNfdW5p dHRlc3QucHkKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PQotLS0gVG9vbHMvQ0lTdXBwb3J0L2V3cy1idWlsZC9zdGVwc191 bml0dGVzdC5weQkocmV2aXNpb24gMjc3ODcyKQorKysgVG9vbHMvQ0lTdXBwb3J0L2V3cy1idWls ZC9zdGVwc191bml0dGVzdC5weQkod29ya2luZyBjb3B5KQpAQCAtMTkzNCw2ICsxOTM0LDcgQEAg Y2xhc3MgVGVzdFJ1bldlYktpdFRlc3RzSW5TdHJlc3NNb2RlKEJ1aQogICAgICAgICBzZWxmLmNv bmZpZ3VyZVN0ZXAoKQogICAgICAgICBzZWxmLnNldFByb3BlcnR5KCdmdWxsUGxhdGZvcm0nLCAn aW9zLXNpbXVsYXRvcicpCiAgICAgICAgIHNlbGYuc2V0UHJvcGVydHkoJ2NvbmZpZ3VyYXRpb24n LCAncmVsZWFzZScpCisgICAgICAgIHNlbGYuc2V0UHJvcGVydHkoJ21vZGlmaWVkX3Rlc3RzJywg Wyd0ZXN0MScsICd0ZXN0MiddKQogICAgICAgICBzZWxmLmV4cGVjdFJlbW90ZUNvbW1hbmRzKAog ICAgICAgICAgICAgRXhwZWN0U2hlbGwod29ya2Rpcj0nd2tkaXInLAogICAgICAgICAgICAgICAg ICAgICAgICAgbG9nZmlsZXM9eydqc29uJzogc2VsZi5qc29uRmlsZU5hbWV9LApAQCAtMTk0Myw3 ICsxOTQ0LDcgQEAgY2xhc3MgVGVzdFJ1bldlYktpdFRlc3RzSW5TdHJlc3NNb2RlKEJ1aQogICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJy0tbm8tYnVpbGQnLCAnLS1uby1zaG93LXJl c3VsdHMnLCAnLS1uby1uZXctdGVzdC1yZXN1bHRzJywgJy0tY2xvYmJlci1vbGQtcmVzdWx0cycs CiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAnLS1yZWxlYXNlJywgJy0tcmVzdWx0 cy1kaXJlY3RvcnknLCAnbGF5b3V0LXRlc3QtcmVzdWx0cycsICctLWRlYnVnLXJ3dC1sb2dnaW5n JywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICctLWV4aXQtYWZ0ZXItbi1mYWls dXJlcycsICcxMCcsICctLXNraXAtZmFpbGluZy10ZXN0cycsCi0gICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAnLS1pdGVyYXRpb25zJywgMTAwXSwKKyAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICctLWl0ZXJhdGlvbnMnLCAxMDAsICd0ZXN0MScsICd0ZXN0MiddLAogICAg ICAgICAgICAgICAgICAgICAgICAgKQogICAgICAgICAgICAgKyAwLAogICAgICAgICApCkBAIC0x OTU0LDYgKzE5NTUsNyBAQCBjbGFzcyBUZXN0UnVuV2ViS2l0VGVzdHNJblN0cmVzc01vZGUoQnVp CiAgICAgICAgIHNlbGYuY29uZmlndXJlU3RlcCgpCiAgICAgICAgIHNlbGYuc2V0UHJvcGVydHko J2Z1bGxQbGF0Zm9ybScsICdpb3Mtc2ltdWxhdG9yJykKICAgICAgICAgc2VsZi5zZXRQcm9wZXJ0 eSgnY29uZmlndXJhdGlvbicsICdyZWxlYXNlJykKKyAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgn bW9kaWZpZWRfdGVzdHMnLCBbJ3Rlc3QnXSkKICAgICAgICAgc2VsZi5leHBlY3RSZW1vdGVDb21t YW5kcygKICAgICAgICAgICAgIEV4cGVjdFNoZWxsKHdvcmtkaXI9J3drZGlyJywKICAgICAgICAg ICAgICAgICAgICAgICAgIGxvZ2ZpbGVzPXsnanNvbic6IHNlbGYuanNvbkZpbGVOYW1lfSwKQEAg LTE5NjMsNyArMTk2NSw3IEBAIGNsYXNzIFRlc3RSdW5XZWJLaXRUZXN0c0luU3RyZXNzTW9kZShC dWkKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICctLW5vLWJ1aWxkJywgJy0tbm8t c2hvdy1yZXN1bHRzJywgJy0tbm8tbmV3LXRlc3QtcmVzdWx0cycsICctLWNsb2JiZXItb2xkLXJl c3VsdHMnLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJy0tcmVsZWFzZScsICct LXJlc3VsdHMtZGlyZWN0b3J5JywgJ2xheW91dC10ZXN0LXJlc3VsdHMnLCAnLS1kZWJ1Zy1yd3Qt bG9nZ2luZycsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAnLS1leGl0LWFmdGVy LW4tZmFpbHVyZXMnLCAnMTAnLCAnLS1za2lwLWZhaWxpbmctdGVzdHMnLAotICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgJy0taXRlcmF0aW9ucycsIDEwMF0sCisgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAnLS1pdGVyYXRpb25zJywgMTAwLCAndGVzdCddLAogICAgICAg ICAgICAgICAgICAgICAgICAgKQogICAgICAgICAgICAgKyBFeHBlY3RTaGVsbC5sb2coJ3N0ZGlv Jywgc3Rkb3V0PSc5IGZhaWx1cmVzIGZvdW5kLicpCiAgICAgICAgICAgICArIDIsCkBAIC0xOTky LDYgKzE5OTQsNyBAQCBjbGFzcyBUZXN0UnVuV2ViS2l0VGVzdHNJblN0cmVzc0d1YXJkbWFsCiAg ICAgICAgIHNlbGYuY29uZmlndXJlU3RlcCgpCiAgICAgICAgIHNlbGYuc2V0UHJvcGVydHkoJ2Z1 bGxQbGF0Zm9ybScsICdpb3Mtc2ltdWxhdG9yJykKICAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgn Y29uZmlndXJhdGlvbicsICdyZWxlYXNlJykKKyAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgnbW9k aWZpZWRfdGVzdHMnLCBbJ3Rlc3QxJywgJ3Rlc3QyJ10pCiAgICAgICAgIHNlbGYuZXhwZWN0UmVt b3RlQ29tbWFuZHMoCiAgICAgICAgICAgICBFeHBlY3RTaGVsbCh3b3JrZGlyPSd3a2RpcicsCiAg ICAgICAgICAgICAgICAgICAgICAgICBsb2dmaWxlcz17J2pzb24nOiBzZWxmLmpzb25GaWxlTmFt ZX0sCkBAIC0yMDAxLDcgKzIwMDQsNyBAQCBjbGFzcyBUZXN0UnVuV2ViS2l0VGVzdHNJblN0cmVz c0d1YXJkbWFsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAnLS1uby1idWlsZCcs ICctLW5vLXNob3ctcmVzdWx0cycsICctLW5vLW5ldy10ZXN0LXJlc3VsdHMnLCAnLS1jbG9iYmVy LW9sZC1yZXN1bHRzJywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICctLXJlbGVh c2UnLCAnLS1yZXN1bHRzLWRpcmVjdG9yeScsICdsYXlvdXQtdGVzdC1yZXN1bHRzJywgJy0tZGVi dWctcnd0LWxvZ2dpbmcnLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJy0tZXhp dC1hZnRlci1uLWZhaWx1cmVzJywgJzEwJywgJy0tc2tpcC1mYWlsaW5nLXRlc3RzJywgJy0tZ3Vh cmQtbWFsbG9jJywKLSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICctLWl0ZXJhdGlv bnMnLCAxMDBdLAorICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJy0taXRlcmF0aW9u cycsIDEwMCwgJ3Rlc3QxJywgJ3Rlc3QyJ10sCiAgICAgICAgICAgICAgICAgICAgICAgICApCiAg ICAgICAgICAgICArIDAsCiAgICAgICAgICkKQEAgLTIwMTIsNiArMjAxNSw3IEBAIGNsYXNzIFRl c3RSdW5XZWJLaXRUZXN0c0luU3RyZXNzR3VhcmRtYWwKICAgICAgICAgc2VsZi5jb25maWd1cmVT dGVwKCkKICAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgnZnVsbFBsYXRmb3JtJywgJ2lvcy1zaW11 bGF0b3InKQogICAgICAgICBzZWxmLnNldFByb3BlcnR5KCdjb25maWd1cmF0aW9uJywgJ3JlbGVh c2UnKQorICAgICAgICBzZWxmLnNldFByb3BlcnR5KCdtb2RpZmllZF90ZXN0cycsIFsndGVzdCdd KQogICAgICAgICBzZWxmLmV4cGVjdFJlbW90ZUNvbW1hbmRzKAogICAgICAgICAgICAgRXhwZWN0 U2hlbGwod29ya2Rpcj0nd2tkaXInLAogICAgICAgICAgICAgICAgICAgICAgICAgbG9nZmlsZXM9 eydqc29uJzogc2VsZi5qc29uRmlsZU5hbWV9LApAQCAtMjAyMSw3ICsyMDI1LDcgQEAgY2xhc3Mg VGVzdFJ1bldlYktpdFRlc3RzSW5TdHJlc3NHdWFyZG1hbAogICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgJy0tbm8tYnVpbGQnLCAnLS1uby1zaG93LXJlc3VsdHMnLCAnLS1uby1uZXct dGVzdC1yZXN1bHRzJywgJy0tY2xvYmJlci1vbGQtcmVzdWx0cycsCiAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAnLS1yZWxlYXNlJywgJy0tcmVzdWx0cy1kaXJlY3RvcnknLCAnbGF5 b3V0LXRlc3QtcmVzdWx0cycsICctLWRlYnVnLXJ3dC1sb2dnaW5nJywKICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICctLWV4aXQtYWZ0ZXItbi1mYWlsdXJlcycsICcxMCcsICctLXNr aXAtZmFpbGluZy10ZXN0cycsICctLWd1YXJkLW1hbGxvYycsCi0gICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAnLS1pdGVyYXRpb25zJywgMTAwXSwKKyAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICctLWl0ZXJhdGlvbnMnLCAxMDAsICd0ZXN0J10sCiAgICAgICAgICAgICAg ICAgICAgICAgICApCiAgICAgICAgICAgICArIEV4cGVjdFNoZWxsLmxvZygnc3RkaW8nLCBzdGRv dXQ9JzkgZmFpbHVyZXMgZm91bmQuJykKICAgICAgICAgICAgICsgMiwKQEAgLTI4MjIsNyArMjgy Niw3IEBAIGNsYXNzIFRlc3RGaW5kTW9kaWZpZWRMYXlvdXRUZXN0cyhCdWlsZFMKICAgICAgICAg ZGlyX25hbWVzID0gWydyZWZlcmVuY2UnLCAncmVmdGVzdCcsICdyZXNvdXJjZXMnLCAnc3VwcG9y dCcsICdzY3JpcHQtdGVzdHMnLCAndG9vbHMnXQogICAgICAgICBmb3IgZGlyX25hbWUgaW4gZGly X25hbWVzOgogICAgICAgICAgICAgRmluZE1vZGlmaWVkTGF5b3V0VGVzdHMuX2dldF9wYXRjaCA9 IGxhbWJkYSB4OiAnKysrIExheW91dFRlc3RzL3t9L3Rlc3QtbmFtZS5odG1sJy5mb3JtYXQoZGly X25hbWUpLmVuY29kZSgndXRmLTgnKQotICAgICAgICAgICAgc2VsZi5leHBlY3RPdXRjb21lKHJl c3VsdD1GQUlMVVJFLCBzdGF0ZV9zdHJpbmc9J1BhdGNoIGRvZXNuXCd0IGhhdmUgcmVsZXZhbnQg Y2hhbmdlcycpCisgICAgICAgICAgICBzZWxmLmV4cGVjdE91dGNvbWUocmVzdWx0PVNLSVBQRUQs IHN0YXRlX3N0cmluZz0nUGF0Y2ggZG9lc25cJ3QgaGF2ZSByZWxldmFudCBjaGFuZ2VzJykKICAg ICAgICAgICAgIHJjID0gc2VsZi5ydW5TdGVwKCkKICAgICAgICAgICAgIHNlbGYuYXNzZXJ0RXF1 YWwoc2VsZi5nZXRQcm9wZXJ0eSgnbW9kaWZpZWRfdGVzdHMnKSwgTm9uZSkKICAgICAgICAgcmV0 dXJuIHJjCkBAIC0yODMyLDcgKzI4MzYsNyBAQCBjbGFzcyBUZXN0RmluZE1vZGlmaWVkTGF5b3V0 VGVzdHMoQnVpbGRTCiAgICAgICAgIHN1ZmZpeGVzID0gWyctZXhwZWN0ZWQnLCAnLWV4cGVjdGVk LW1pc21hdGNoJywgJy1yZWYnLCAnLW5vdHJlZiddCiAgICAgICAgIGZvciBzdWZmaXggaW4gc3Vm Zml4ZXM6CiAgICAgICAgICAgICBGaW5kTW9kaWZpZWRMYXlvdXRUZXN0cy5fZ2V0X3BhdGNoID0g bGFtYmRhIHg6ICcrKysgTGF5b3V0VGVzdHMvaHR0cC90ZXN0cy9ldmVudHMvZGV2aWNlLW1vdGlv bi17fS5odG1sJy5mb3JtYXQoc3VmZml4KS5lbmNvZGUoJ3V0Zi04JykKLSAgICAgICAgICAgIHNl bGYuZXhwZWN0T3V0Y29tZShyZXN1bHQ9RkFJTFVSRSwgc3RhdGVfc3RyaW5nPSdQYXRjaCBkb2Vz blwndCBoYXZlIHJlbGV2YW50IGNoYW5nZXMnKQorICAgICAgICAgICAgc2VsZi5leHBlY3RPdXRj b21lKHJlc3VsdD1TS0lQUEVELCBzdGF0ZV9zdHJpbmc9J1BhdGNoIGRvZXNuXCd0IGhhdmUgcmVs ZXZhbnQgY2hhbmdlcycpCiAgICAgICAgICAgICByYyA9IHNlbGYucnVuU3RlcCgpCiAgICAgICAg ICAgICBzZWxmLmFzc2VydEVxdWFsKHNlbGYuZ2V0UHJvcGVydHkoJ21vZGlmaWVkX3Rlc3RzJyks IE5vbmUpCiAgICAgICAgIHJldHVybiByYwpAQCAtMjg0MCw3ICsyODQ0LDcgQEAgY2xhc3MgVGVz dEZpbmRNb2RpZmllZExheW91dFRlc3RzKEJ1aWxkUwogICAgIGRlZiB0ZXN0X2lnbm9yZV9ub25f bGF5b3V0X3Rlc3RfaW5faHRtbF9kaXJlY3Rvcnkoc2VsZik6CiAgICAgICAgIHNlbGYuc2V0dXBT dGVwKEZpbmRNb2RpZmllZExheW91dFRlc3RzKCkpCiAgICAgICAgIEZpbmRNb2RpZmllZExheW91 dFRlc3RzLl9nZXRfcGF0Y2ggPSBsYW1iZGEgeDogJysrKyBMYXlvdXRUZXN0cy9odG1sL3Rlc3Qu dHh0Jy5lbmNvZGUoJ3V0Zi04JykKLSAgICAgICAgc2VsZi5leHBlY3RPdXRjb21lKHJlc3VsdD1G QUlMVVJFLCBzdGF0ZV9zdHJpbmc9J1BhdGNoIGRvZXNuXCd0IGhhdmUgcmVsZXZhbnQgY2hhbmdl cycpCisgICAgICAgIHNlbGYuZXhwZWN0T3V0Y29tZShyZXN1bHQ9U0tJUFBFRCwgc3RhdGVfc3Ry aW5nPSdQYXRjaCBkb2VzblwndCBoYXZlIHJlbGV2YW50IGNoYW5nZXMnKQogICAgICAgICByYyA9 IHNlbGYucnVuU3RlcCgpCiAgICAgICAgIHNlbGYuYXNzZXJ0RXF1YWwoc2VsZi5nZXRQcm9wZXJ0 eSgnbW9kaWZpZWRfdGVzdHMnKSwgTm9uZSkKICAgICAgICAgcmV0dXJuIHJjCkBAIC0yODQ4LDcg KzI4NTIsNyBAQCBjbGFzcyBUZXN0RmluZE1vZGlmaWVkTGF5b3V0VGVzdHMoQnVpbGRTCiAgICAg ZGVmIHRlc3Rfbm9uX3JlbGV2YW50X3BhdGNoKHNlbGYpOgogICAgICAgICBzZWxmLnNldHVwU3Rl cChGaW5kTW9kaWZpZWRMYXlvdXRUZXN0cygpKQogICAgICAgICBGaW5kTW9kaWZpZWRMYXlvdXRU ZXN0cy5fZ2V0X3BhdGNoID0gbGFtYmRhIHg6IGInU2FtcGxlIHBhdGNoIHdoaWNoIGRvZXMgbm90 IG1vZGlmeSBhbnkgbGF5b3V0IHRlc3QnCi0gICAgICAgIHNlbGYuZXhwZWN0T3V0Y29tZShyZXN1 bHQ9RkFJTFVSRSwgc3RhdGVfc3RyaW5nPSdQYXRjaCBkb2VzblwndCBoYXZlIHJlbGV2YW50IGNo YW5nZXMnKQorICAgICAgICBzZWxmLmV4cGVjdE91dGNvbWUocmVzdWx0PVNLSVBQRUQsIHN0YXRl X3N0cmluZz0nUGF0Y2ggZG9lc25cJ3QgaGF2ZSByZWxldmFudCBjaGFuZ2VzJykKICAgICAgICAg cmMgPSBzZWxmLnJ1blN0ZXAoKQogICAgICAgICBzZWxmLmFzc2VydEVxdWFsKHNlbGYuZ2V0UHJv cGVydHkoJ21vZGlmaWVkX3Rlc3RzJyksIE5vbmUpCiAgICAgICAgIHJldHVybiByYwo=