78012 2012-02-07 11:45:04 -0800 run-perf-tests doesn't recognize paths that start with PerformanceTests 2012-02-08 01:51:25 -0800 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) Unspecified Unspecified RESOLVED FIXED P2 Normal --- 77037 1 rniwa rniwa abarth dpranke menard morrita ojan tony webkit.review.bot oldest_to_newest 551190 0 rniwa 2012-02-07 11:45:04 -0800 run-perf-tests PerformanceTests/Parser runs exactly 0 tests because run-perf-tests recognizes that as PerformanceTests/PerformanceTests/Parser. It's annoying as hell. 551247 1 abarth 2012-02-07 12:35:19 -0800 run-webkit-tests has some code to remove the LayoutTests from command line arguments. Presumably you want something similar here. 551335 2 rniwa 2012-02-07 13:49:12 -0800 (In reply to comment #1) > run-webkit-tests has some code to remove the LayoutTests from command line arguments. Presumably you want something similar here. Something like that. I just looked at its implementation in manager.py and it seems way too complicated for run-perf-test. I'm just going to use filesystem.relpath instead. 551452 3 125942 rniwa 2012-02-07 15:18:29 -0800 Created attachment 125942 Fixes the bug 551454 4 rniwa 2012-02-07 15:19:33 -0800 I feel like we should be able to use the same approach in run-webkit-tests but there's some special treatment for / and \ there so not sure if that's possible. 551526 5 125942 abarth 2012-02-07 16:14:59 -0800 Comment on attachment 125942 Fixes the bug View in context: https://bugs.webkit.org/attachment.cgi?id=125942&action=review > Tools/Scripts/webkitpy/performance_tests/perftestsrunner.py:111 > + if self._host.filesystem.exists(arg): It's strange that this checks the real file system for existence. I would expect this to be a syntactic transformation that doesn't query the local file system. 551536 6 125942 rniwa 2012-02-07 16:28:31 -0800 Comment on attachment 125942 Fixes the bug View in context: https://bugs.webkit.org/attachment.cgi?id=125942&action=review >> Tools/Scripts/webkitpy/performance_tests/perftestsrunner.py:111 >> + if self._host.filesystem.exists(arg): > > It's strange that this checks the real file system for existence. I would expect this to be a syntactic transformation that doesn't query the local file system. Otherwise how would I figure out whether we should use relpath or not? An alternative is to add both since find_files.find only finds existing files. 551541 7 abarth 2012-02-07 16:33:01 -0800 > Otherwise how would I figure out whether we should use relpath or not? An alternative is to add both since find_files.find only finds existing files. That could work. You can also look whether the string PerformanceTests appears in the path. 551543 8 rniwa 2012-02-07 16:35:31 -0800 (In reply to comment #7) > > Otherwise how would I figure out whether we should use relpath or not? An alternative is to add both since find_files.find only finds existing files. > > That could work. You can also look whether the string PerformanceTests appears in the path. I want to avoid hard-coding "PerformanceTests" since I'm hoping that I can also replace the equivalent function in manager.py by this one as a followup. 551782 9 morrita 2012-02-07 21:47:12 -0800 (In reply to comment #8) > I want to avoid hard-coding "PerformanceTests" since I'm hoping that I can also replace the equivalent function in manager.py by this one as a followup. You can just pass the "base directory name" as an argument to the (coming shared) function. Avoiding file system access is good for performance reason. In this case, startup speed. Anyway, I like this change. I'm tired to remove "PerformanceTest" part from my completed-by-the-shell path ;-) 551873 10 126024 rniwa 2012-02-08 01:10:41 -0800 Created attachment 126024 Updated per Adam's comment 551874 11 126024 abarth 2012-02-08 01:15:56 -0800 Comment on attachment 126024 Updated per Adam's comment That certainly looks nicer. :) 551897 12 rniwa 2012-02-08 01:51:25 -0800 Committed r107053: <http://trac.webkit.org/changeset/107053> 125942 2012-02-07 15:18:29 -0800 2012-02-08 01:10:35 -0800 Fixes the bug bug-78012-20120207151828.patch text/plain 4992 rniwa SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl dmlzaW9uIDEwNjk5NikKKysrIFRvb2xzL0NoYW5nZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwz ICsxLDI3IEBACisyMDEyLTAyLTA3ICBSeW9zdWtlIE5pd2EgIDxybml3YUB3ZWJraXQub3JnPgor CisgICAgICAgIHJ1bi1wZXJmLXRlc3RzIGRvZXNuJ3QgcmVjb2duaXplIHBhdGhzIHRoYXQgc3Rh cnQgd2l0aCBQZXJmb3JtYW5jZVRlc3RzCisgICAgICAgIGh0dHBzOi8vYnVncy53ZWJraXQub3Jn L3Nob3dfYnVnLmNnaT9pZD03ODAxMgorCisgICAgICAgIFJldmlld2VkIGJ5IE5PQk9EWSAoT09Q UyEpLgorCisgICAgICAgIFVzZSByZXNvbHZlIHBhdGhzIHVzaW5nIGZpbGVzeXN0ZW0ucmVscGF0 aCBiZWZvcmUgcGFzc2luZyBpdCB0byBmaW5kX2ZpbGVzLmZpbmQuCisgICAgICAgIEFsc28gZml4 ZWQgdGhlIG1vY2sgZmlsZXN5c3RlbSB0byBwcm9wZXJseSBzdXBwb3J0IHRoZSBjdXJyZW50IHdv cmtpbmcgZGlyZWN0b3J5LgorCisgICAgICAgICogU2NyaXB0cy93ZWJraXRweS9jb21tb24vc3lz dGVtL2ZpbGVzeXN0ZW1fbW9jay5weToKKyAgICAgICAgKE1vY2tGaWxlU3lzdGVtLmlzZmlsZSk6 CisgICAgICAgIChNb2NrRmlsZVN5c3RlbSk6CisgICAgICAgIChNb2NrRmlsZVN5c3RlbS5faXNm aWxlKToKKyAgICAgICAgKE1vY2tGaWxlU3lzdGVtLmlzZGlyKToKKyAgICAgICAgKE1vY2tGaWxl U3lzdGVtLl9pc2Rpcik6CisgICAgICAgIChNb2NrRmlsZVN5c3RlbS5yZWxwYXRoKToKKyAgICAg ICAgKiBTY3JpcHRzL3dlYmtpdHB5L3BlcmZvcm1hbmNlX3Rlc3RzL3BlcmZ0ZXN0c3J1bm5lci5w eToKKyAgICAgICAgKFBlcmZUZXN0c1J1bm5lcik6CisgICAgICAgIChQZXJmVGVzdHNSdW5uZXIu X2NvbGxlY3RfdGVzdHMpOgorICAgICAgICAqIFNjcmlwdHMvd2Via2l0cHkvcGVyZm9ybWFuY2Vf dGVzdHMvcGVyZnRlc3RzcnVubmVyX3VuaXR0ZXN0LnB5OgorICAgICAgICAodGVzdF9jb2xsZWN0 X3Rlc3RzKToKKyAgICAgICAgKHRlc3RfY29sbGVjdF90ZXN0cy5hZGRfZmlsZSk6CisKIDIwMTIt MDItMDcgIENocmlzIFJvZ2VycyAgPGNyb2dlcnNAZ29vZ2xlLmNvbT4KIAogICAgICAgICBBZGQg Q2hyaXMgUm9nZXJzIHRvIHJldmlld2VycyBzZWN0aW9uCkluZGV4OiBUb29scy9TY3JpcHRzL3dl YmtpdHB5L2NvbW1vbi9zeXN0ZW0vZmlsZXN5c3RlbV9tb2NrLnB5Cj09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIFRv b2xzL1NjcmlwdHMvd2Via2l0cHkvY29tbW9uL3N5c3RlbS9maWxlc3lzdGVtX21vY2sucHkJKHJl dmlzaW9uIDEwNjkwMykKKysrIFRvb2xzL1NjcmlwdHMvd2Via2l0cHkvY29tbW9uL3N5c3RlbS9m aWxlc3lzdGVtX21vY2sucHkJKHdvcmtpbmcgY29weSkKQEAgLTE2Nyw5ICsxNjcsMTUgQEAgY2xh c3MgTW9ja0ZpbGVTeXN0ZW0ob2JqZWN0KToKICAgICAgICAgcmV0dXJuIHBhdGguc3RhcnRzd2l0 aChzZWxmLnNlcCkKIAogICAgIGRlZiBpc2ZpbGUoc2VsZiwgcGF0aCk6CisgICAgICAgIHJldHVy biBzZWxmLl9pc2ZpbGUocGF0aCkgb3Igc2VsZi5faXNmaWxlKHNlbGYuam9pbihzZWxmLmN3ZCwg cGF0aCkpCisKKyAgICBkZWYgX2lzZmlsZShzZWxmLCBwYXRoKToKICAgICAgICAgcmV0dXJuIHBh dGggaW4gc2VsZi5maWxlcyBhbmQgc2VsZi5maWxlc1twYXRoXSBpcyBub3QgTm9uZQogCiAgICAg ZGVmIGlzZGlyKHNlbGYsIHBhdGgpOgorICAgICAgICByZXR1cm4gc2VsZi5faXNkaXIocGF0aCkg b3Igc2VsZi5faXNkaXIoc2VsZi5qb2luKHNlbGYuY3dkLCBwYXRoKSkKKworICAgIGRlZiBfaXNk aXIoc2VsZiwgcGF0aCk6CiAgICAgICAgIGlmIHBhdGggaW4gc2VsZi5maWxlczoKICAgICAgICAg ICAgIHJldHVybiBGYWxzZQogICAgICAgICBwYXRoID0gc2VsZi5ub3JtcGF0aChwYXRoKQpAQCAt MzAyLDcgKzMwOCw5IEBAIGNsYXNzIE1vY2tGaWxlU3lzdGVtKG9iamVjdCk6CiAgICAgICAgIGNv bnRlbnRzID0gc2VsZi5yZWFkX2JpbmFyeV9maWxlKHBhdGgpCiAgICAgICAgIHJldHVybiBoYXNo bGliLnNoYTEoY29udGVudHMpLmhleGRpZ2VzdCgpCiAKLSAgICBkZWYgcmVscGF0aChzZWxmLCBw YXRoLCBzdGFydD0nLicpOgorICAgIGRlZiByZWxwYXRoKHNlbGYsIHBhdGgsIHN0YXJ0PU5vbmUp OgorICAgICAgICBpZiBzdGFydCA9PSBOb25lOgorICAgICAgICAgICAgc3RhcnQgPSBzZWxmLmN3 ZAogICAgICAgICByZXR1cm4gb3NwYXRoLnJlbHBhdGgocGF0aCwgc3RhcnQsIHNlbGYuYWJzcGF0 aCwgc2VsZi5zZXApCiAKICAgICBkZWYgcmVtb3ZlKHNlbGYsIHBhdGgpOgpJbmRleDogVG9vbHMv U2NyaXB0cy93ZWJraXRweS9wZXJmb3JtYW5jZV90ZXN0cy9wZXJmdGVzdHNydW5uZXIucHkKPT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PQotLS0gVG9vbHMvU2NyaXB0cy93ZWJraXRweS9wZXJmb3JtYW5jZV90ZXN0cy9wZXJm dGVzdHNydW5uZXIucHkJKHJldmlzaW9uIDEwNjkwMykKKysrIFRvb2xzL1NjcmlwdHMvd2Via2l0 cHkvcGVyZm9ybWFuY2VfdGVzdHMvcGVyZnRlc3RzcnVubmVyLnB5CSh3b3JraW5nIGNvcHkpCkBA IC00Niw3ICs0Niw2IEBAIF9sb2cgPSBsb2dnaW5nLmdldExvZ2dlcihfX25hbWVfXykKIAogCiBj bGFzcyBQZXJmVGVzdHNSdW5uZXIob2JqZWN0KToKLSAgICBfcGVyZl90ZXN0c19iYXNlX2RpciA9 ICdQZXJmb3JtYW5jZVRlc3RzJwogICAgIF90ZXN0X2RpcmVjdG9yaWVzX2Zvcl9jaHJvbWl1bV9z dHlsZV90ZXN0cyA9IFsnaW5zcGVjdG9yJ10KICAgICBfZGVmYXVsdF9icmFuY2ggPSAnd2Via2l0 LXRydW5rJwogICAgIF9FWElUX0NPREVfQkFEX0JVSUxEID0gLTEKQEAgLTEwNyw4ICsxMDYsMTUg QEAgY2xhc3MgUGVyZlRlc3RzUnVubmVyKG9iamVjdCk6CiAgICAgICAgIGRlZiBfaXNfdGVzdF9m aWxlKGZpbGVzeXN0ZW0sIGRpcm5hbWUsIGZpbGVuYW1lKToKICAgICAgICAgICAgIHJldHVybiBm aWxlbmFtZS5lbmRzd2l0aCgnLmh0bWwnKQogCisgICAgICAgIHBhdGhzID0gW10KKyAgICAgICAg Zm9yIGFyZyBpbiBzZWxmLl9hcmdzOgorICAgICAgICAgICAgaWYgc2VsZi5faG9zdC5maWxlc3lz dGVtLmV4aXN0cyhhcmcpOgorICAgICAgICAgICAgICAgIHBhdGhzLmFwcGVuZChzZWxmLl9ob3N0 LmZpbGVzeXN0ZW0ucmVscGF0aChhcmcsIHNlbGYuX2Jhc2VfcGF0aCkpCisgICAgICAgICAgICBl bHNlOgorICAgICAgICAgICAgICAgIHBhdGhzLmFwcGVuZChhcmcpCisKICAgICAgICAgc2tpcHBl ZF9kaXJlY3RvcmllcyA9IHNldChbJy5zdm4nLCAncmVzb3VyY2VzJ10pCi0gICAgICAgIHRlc3Rz ID0gZmluZF9maWxlcy5maW5kKHNlbGYuX2hvc3QuZmlsZXN5c3RlbSwgc2VsZi5fYmFzZV9wYXRo LCBzZWxmLl9hcmdzLCBza2lwcGVkX2RpcmVjdG9yaWVzLCBfaXNfdGVzdF9maWxlKQorICAgICAg ICB0ZXN0cyA9IGZpbmRfZmlsZXMuZmluZChzZWxmLl9ob3N0LmZpbGVzeXN0ZW0sIHNlbGYuX2Jh c2VfcGF0aCwgcGF0aHMsIHNraXBwZWRfZGlyZWN0b3JpZXMsIF9pc190ZXN0X2ZpbGUpCiAgICAg ICAgIHJldHVybiBbdGVzdCBmb3IgdGVzdCBpbiB0ZXN0cyBpZiBub3Qgc2VsZi5fcG9ydC5za2lw c19wZXJmX3Rlc3Qoc2VsZi5fcG9ydC5yZWxhdGl2ZV9wZXJmX3Rlc3RfZmlsZW5hbWUodGVzdCkp XQogCiAgICAgZGVmIHJ1bihzZWxmKToKSW5kZXg6IFRvb2xzL1NjcmlwdHMvd2Via2l0cHkvcGVy Zm9ybWFuY2VfdGVzdHMvcGVyZnRlc3RzcnVubmVyX3VuaXR0ZXN0LnB5Cj09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0t IFRvb2xzL1NjcmlwdHMvd2Via2l0cHkvcGVyZm9ybWFuY2VfdGVzdHMvcGVyZnRlc3RzcnVubmVy X3VuaXR0ZXN0LnB5CShyZXZpc2lvbiAxMDY5MDMpCisrKyBUb29scy9TY3JpcHRzL3dlYmtpdHB5 L3BlcmZvcm1hbmNlX3Rlc3RzL3BlcmZ0ZXN0c3J1bm5lcl91bml0dGVzdC5weQkod29ya2luZyBj b3B5KQpAQCAtMzA3LDYgKzMwNywxOSBAQCBtYXggMTEyMAogICAgICAgICB0ZXN0cyA9IHJ1bm5l ci5fY29sbGVjdF90ZXN0cygpCiAgICAgICAgIHNlbGYuYXNzZXJ0RXF1YWwobGVuKHRlc3RzKSwg MSkKIAorICAgIGRlZiB0ZXN0X2NvbGxlY3RfdGVzdHMoc2VsZik6CisgICAgICAgIHJ1bm5lciA9 IHNlbGYuY3JlYXRlX3J1bm5lcihhcmdzPVsnUGVyZm9ybWFuY2VUZXN0cy90ZXN0MS5odG1sJywg J3Rlc3QyLmh0bWwnXSkKKworICAgICAgICBkZWYgYWRkX2ZpbGUoZmlsZW5hbWUpOgorICAgICAg ICAgICAgcnVubmVyLl9ob3N0LmZpbGVzeXN0ZW0uZmlsZXNbcnVubmVyLl9ob3N0LmZpbGVzeXN0 ZW0uam9pbihydW5uZXIuX2Jhc2VfcGF0aCwgZmlsZW5hbWUpXSA9ICdzb21lIGNvbnRlbnQnCisK KyAgICAgICAgYWRkX2ZpbGUoJ3Rlc3QxLmh0bWwnKQorICAgICAgICBhZGRfZmlsZSgndGVzdDIu aHRtbCcpCisgICAgICAgIGFkZF9maWxlKCd0ZXN0My5odG1sJykKKyAgICAgICAgcnVubmVyLl9o b3N0LmZpbGVzeXN0ZW0uY2hkaXIocnVubmVyLl9wb3J0LndlYmtpdF9iYXNlKCkpCisgICAgICAg IHRlc3RzID0gW3J1bm5lci5fcG9ydC5yZWxhdGl2ZV9wZXJmX3Rlc3RfZmlsZW5hbWUodGVzdCkg Zm9yIHRlc3QgaW4gcnVubmVyLl9jb2xsZWN0X3Rlc3RzKCldCisgICAgICAgIHNlbGYuYXNzZXJ0 RXF1YWwoc29ydGVkKHRlc3RzKSwgWyd0ZXN0MS5odG1sJywgJ3Rlc3QyLmh0bWwnXSkKKwogICAg IGRlZiB0ZXN0X2NvbGxlY3RfdGVzdHNfd2l0aF9za2lwcGVkX2xpc3Qoc2VsZik6CiAgICAgICAg IHJ1bm5lciA9IHNlbGYuY3JlYXRlX3J1bm5lcigpCiAK 126024 2012-02-08 01:10:41 -0800 2012-02-08 01:15:56 -0800 Updated per Adam's comment bug-78012-20120208011040.patch text/plain 3416 rniwa SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl dmlzaW9uIDEwNjk5NikKKysrIFRvb2xzL0NoYW5nZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwz ICsxLDE5IEBACisyMDEyLTAyLTA3ICBSeW9zdWtlIE5pd2EgIDxybml3YUB3ZWJraXQub3JnPgor CisgICAgICAgIHJ1bi1wZXJmLXRlc3RzIGRvZXNuJ3QgcmVjb2duaXplIHBhdGhzIHRoYXQgc3Rh cnQgd2l0aCBQZXJmb3JtYW5jZVRlc3RzCisgICAgICAgIGh0dHBzOi8vYnVncy53ZWJraXQub3Jn L3Nob3dfYnVnLmNnaT9pZD03ODAxMgorCisgICAgICAgIFJldmlld2VkIGJ5IE5PQk9EWSAoT09Q UyEpLgorCisgICAgICAgIFVzZSByZXNvbHZlIHBhdGhzIHVzaW5nIGZpbGVzeXN0ZW0ucmVscGF0 aCBiZWZvcmUgcGFzc2luZyBpdCB0byBmaW5kX2ZpbGVzLmZpbmQuCisKKyAgICAgICAgKiBTY3Jp cHRzL3dlYmtpdHB5L3BlcmZvcm1hbmNlX3Rlc3RzL3BlcmZ0ZXN0c3J1bm5lci5weToKKyAgICAg ICAgKFBlcmZUZXN0c1J1bm5lcik6CisgICAgICAgIChQZXJmVGVzdHNSdW5uZXIuX2NvbGxlY3Rf dGVzdHMpOgorICAgICAgICAqIFNjcmlwdHMvd2Via2l0cHkvcGVyZm9ybWFuY2VfdGVzdHMvcGVy ZnRlc3RzcnVubmVyX3VuaXR0ZXN0LnB5OgorICAgICAgICAodGVzdF9jb2xsZWN0X3Rlc3RzKToK KyAgICAgICAgKHRlc3RfY29sbGVjdF90ZXN0cy5hZGRfZmlsZSk6CisKIDIwMTItMDItMDcgIENo cmlzIFJvZ2VycyAgPGNyb2dlcnNAZ29vZ2xlLmNvbT4KIAogICAgICAgICBBZGQgQ2hyaXMgUm9n ZXJzIHRvIHJldmlld2VycyBzZWN0aW9uCkluZGV4OiBUb29scy9TY3JpcHRzL3dlYmtpdHB5L3Bl cmZvcm1hbmNlX3Rlc3RzL3BlcmZ0ZXN0c3J1bm5lci5weQo9PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9T Y3JpcHRzL3dlYmtpdHB5L3BlcmZvcm1hbmNlX3Rlc3RzL3BlcmZ0ZXN0c3J1bm5lci5weQkocmV2 aXNpb24gMTA2OTAzKQorKysgVG9vbHMvU2NyaXB0cy93ZWJraXRweS9wZXJmb3JtYW5jZV90ZXN0 cy9wZXJmdGVzdHNydW5uZXIucHkJKHdvcmtpbmcgY29weSkKQEAgLTQ2LDcgKzQ2LDYgQEAgX2xv ZyA9IGxvZ2dpbmcuZ2V0TG9nZ2VyKF9fbmFtZV9fKQogCiAKIGNsYXNzIFBlcmZUZXN0c1J1bm5l cihvYmplY3QpOgotICAgIF9wZXJmX3Rlc3RzX2Jhc2VfZGlyID0gJ1BlcmZvcm1hbmNlVGVzdHMn CiAgICAgX3Rlc3RfZGlyZWN0b3JpZXNfZm9yX2Nocm9taXVtX3N0eWxlX3Rlc3RzID0gWydpbnNw ZWN0b3InXQogICAgIF9kZWZhdWx0X2JyYW5jaCA9ICd3ZWJraXQtdHJ1bmsnCiAgICAgX0VYSVRf Q09ERV9CQURfQlVJTEQgPSAtMQpAQCAtMTA3LDggKzEwNiwxNSBAQCBjbGFzcyBQZXJmVGVzdHNS dW5uZXIob2JqZWN0KToKICAgICAgICAgZGVmIF9pc190ZXN0X2ZpbGUoZmlsZXN5c3RlbSwgZGly bmFtZSwgZmlsZW5hbWUpOgogICAgICAgICAgICAgcmV0dXJuIGZpbGVuYW1lLmVuZHN3aXRoKCcu aHRtbCcpCiAKKyAgICAgICAgcGF0aHMgPSBbXQorICAgICAgICBmb3IgYXJnIGluIHNlbGYuX2Fy Z3M6CisgICAgICAgICAgICBwYXRocy5hcHBlbmQoYXJnKQorICAgICAgICAgICAgcmVscGF0aCA9 IHNlbGYuX2hvc3QuZmlsZXN5c3RlbS5yZWxwYXRoKGFyZywgc2VsZi5fYmFzZV9wYXRoKQorICAg ICAgICAgICAgaWYgcmVscGF0aDoKKyAgICAgICAgICAgICAgICBwYXRocy5hcHBlbmQocmVscGF0 aCkKKwogICAgICAgICBza2lwcGVkX2RpcmVjdG9yaWVzID0gc2V0KFsnLnN2bicsICdyZXNvdXJj ZXMnXSkKLSAgICAgICAgdGVzdHMgPSBmaW5kX2ZpbGVzLmZpbmQoc2VsZi5faG9zdC5maWxlc3lz dGVtLCBzZWxmLl9iYXNlX3BhdGgsIHNlbGYuX2FyZ3MsIHNraXBwZWRfZGlyZWN0b3JpZXMsIF9p c190ZXN0X2ZpbGUpCisgICAgICAgIHRlc3RzID0gZmluZF9maWxlcy5maW5kKHNlbGYuX2hvc3Qu ZmlsZXN5c3RlbSwgc2VsZi5fYmFzZV9wYXRoLCBwYXRocywgc2tpcHBlZF9kaXJlY3Rvcmllcywg X2lzX3Rlc3RfZmlsZSkKICAgICAgICAgcmV0dXJuIFt0ZXN0IGZvciB0ZXN0IGluIHRlc3RzIGlm IG5vdCBzZWxmLl9wb3J0LnNraXBzX3BlcmZfdGVzdChzZWxmLl9wb3J0LnJlbGF0aXZlX3BlcmZf dGVzdF9maWxlbmFtZSh0ZXN0KSldCiAKICAgICBkZWYgcnVuKHNlbGYpOgpJbmRleDogVG9vbHMv U2NyaXB0cy93ZWJraXRweS9wZXJmb3JtYW5jZV90ZXN0cy9wZXJmdGVzdHNydW5uZXJfdW5pdHRl c3QucHkKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PQotLS0gVG9vbHMvU2NyaXB0cy93ZWJraXRweS9wZXJmb3JtYW5jZV90 ZXN0cy9wZXJmdGVzdHNydW5uZXJfdW5pdHRlc3QucHkJKHJldmlzaW9uIDEwNjkwMykKKysrIFRv b2xzL1NjcmlwdHMvd2Via2l0cHkvcGVyZm9ybWFuY2VfdGVzdHMvcGVyZnRlc3RzcnVubmVyX3Vu aXR0ZXN0LnB5CSh3b3JraW5nIGNvcHkpCkBAIC0zMDcsNiArMzA3LDE5IEBAIG1heCAxMTIwCiAg ICAgICAgIHRlc3RzID0gcnVubmVyLl9jb2xsZWN0X3Rlc3RzKCkKICAgICAgICAgc2VsZi5hc3Nl cnRFcXVhbChsZW4odGVzdHMpLCAxKQogCisgICAgZGVmIHRlc3RfY29sbGVjdF90ZXN0cyhzZWxm KToKKyAgICAgICAgcnVubmVyID0gc2VsZi5jcmVhdGVfcnVubmVyKGFyZ3M9WydQZXJmb3JtYW5j ZVRlc3RzL3Rlc3QxLmh0bWwnLCAndGVzdDIuaHRtbCddKQorCisgICAgICAgIGRlZiBhZGRfZmls ZShmaWxlbmFtZSk6CisgICAgICAgICAgICBydW5uZXIuX2hvc3QuZmlsZXN5c3RlbS5maWxlc1ty dW5uZXIuX2hvc3QuZmlsZXN5c3RlbS5qb2luKHJ1bm5lci5fYmFzZV9wYXRoLCBmaWxlbmFtZSld ID0gJ3NvbWUgY29udGVudCcKKworICAgICAgICBhZGRfZmlsZSgndGVzdDEuaHRtbCcpCisgICAg ICAgIGFkZF9maWxlKCd0ZXN0Mi5odG1sJykKKyAgICAgICAgYWRkX2ZpbGUoJ3Rlc3QzLmh0bWwn KQorICAgICAgICBydW5uZXIuX2hvc3QuZmlsZXN5c3RlbS5jaGRpcihydW5uZXIuX3BvcnQud2Vi a2l0X2Jhc2UoKSkKKyAgICAgICAgdGVzdHMgPSBbcnVubmVyLl9wb3J0LnJlbGF0aXZlX3BlcmZf dGVzdF9maWxlbmFtZSh0ZXN0KSBmb3IgdGVzdCBpbiBydW5uZXIuX2NvbGxlY3RfdGVzdHMoKV0K KyAgICAgICAgc2VsZi5hc3NlcnRFcXVhbChzb3J0ZWQodGVzdHMpLCBbJ3Rlc3QxLmh0bWwnLCAn dGVzdDIuaHRtbCddKQorCiAgICAgZGVmIHRlc3RfY29sbGVjdF90ZXN0c193aXRoX3NraXBwZWRf bGlzdChzZWxmKToKICAgICAgICAgcnVubmVyID0gc2VsZi5jcmVhdGVfcnVubmVyKCkKIAo=