126300 2013-12-30 12:30:44 -0800 full_results.json should distinguish unexpected failures from expected ones 2013-12-30 22:29:48 -0800 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) Unspecified Unspecified RESOLVED FIXED P2 Normal --- 1 ap ap commit-queue glenn rniwa timothy oldest_to_newest 963364 0 ap 2013-12-30 12:30:44 -0800 full_results.json contains expected/actual results for tests, and it contains total counts for regressions, flaky tests and missing results. But it's hard to tell which of the many results are regressions, because the logic for deciding that is convoluted. For example, here is an entry from full_results.json that doesn't count as a regression: "4242293.html":{"expected":"PASS","actual":"TEXT IMAGE","image_diff_percent":0.16} I'm guessing that this is because we are not running image tests, so an image only failure on retry is as good as a pass. But I really don't want to copy this logic in JavaScript - it's already duplicated in at least two places in webkitpy, which is bad enough. My plan is to use full_results.json for results in popovers at <http://build.webkit.org/dashboard>. 963365 1 220119 ap 2013-12-30 12:34:41 -0800 Created attachment 220119 proposed patch 963463 2 ap 2013-12-30 22:29:48 -0800 Committed <http://trac.webkit.org/r161171>. 220119 2013-12-30 12:34:41 -0800 2013-12-30 18:42:02 -0800 proposed patch ReportResult.txt text/plain 9662 ap SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl dmlzaW9uIDE2MTE0OCkKKysrIFRvb2xzL0NoYW5nZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwz ICsxLDIxIEBACisyMDEzLTEyLTMwICBBbGV4ZXkgUHJvc2t1cnlha292ICA8YXBAYXBwbGUuY29t PgorCisgICAgICAgIGZ1bGxfcmVzdWx0cy5qc29uIHNob3VsZCBkaXN0aW5ndWlzaCB1bmV4cGVj dGVkIGZhaWx1cmVzIGZyb20gZXhwZWN0ZWQgb25lcworICAgICAgICBodHRwczovL2J1Z3Mud2Vi a2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9MTI2MzAwCisKKyAgICAgICAgUmV2aWV3ZWQgYnkgTk9C T0RZIChPT1BTISkuCisKKyAgICAgICAgKiBTY3JpcHRzL3dlYmtpdHB5L2xheW91dF90ZXN0cy9t b2RlbHMvdGVzdF9ydW5fcmVzdWx0cy5weToKKyAgICAgICAgKHN1bW1hcml6ZV9yZXN1bHRzKTog QWRkICJyZXBvcnQiIGVsZW1lbnQgdG8gSlNPTiwgd2hpY2ggdGVsbHMgdGhlIGNvbnN1bWVyIGhv dworICAgICAgICB0aGlzIHJlc3VsdCB3YXMgY291bnRlZCBmb3Igc3VtbWFyeS4KKworICAgICAg ICAqIFNjcmlwdHMvd2Via2l0cHkvbGF5b3V0X3Rlc3RzL3J1bl93ZWJraXRfdGVzdHNfaW50ZWdy YXRpb250ZXN0LnB5OgorICAgICAgICBVcGRhdGVkIHJlc3VsdHMgdG8gaW5jbHVkZSB0aGUgbmV3 IGVsZW1lbnQuCisKKyAgICAgICAgKiBTY3JpcHRzL3dlYmtpdHB5L2xheW91dF90ZXN0cy92aWV3 cy9idWlsZGJvdF9yZXN1bHRzLnB5OgorICAgICAgICAocHJpbnRfdW5leHBlY3RlZF9yZXN1bHRz KTogQWRkZWQgYSBjb21tZW50IHBvaW50aW5nIG91dCB0byBhbm90aGVyIHBsYWNlIHRoYXQKKyAg ICAgICAgc3VtbWFyaXplcyByZXN1bHRzLCBhbmQgc2hvdWxkIHN0YXkgaW4gc3luYy4KKwogMjAx My0xMi0zMCAgQ2FybG9zIEdhcmNpYSBDYW1wb3MgIDxjZ2FyY2lhQGlnYWxpYS5jb20+CiAKICAg ICAgICAgW0dUS10gU3BsaXQgV2ViS2l0MkFQSVRlc3RzL1Rlc3RXZWJLaXRXZWJWaWV3CkluZGV4 OiBUb29scy9TY3JpcHRzL3dlYmtpdHB5L2xheW91dF90ZXN0cy9ydW5fd2Via2l0X3Rlc3RzX2lu dGVncmF0aW9udGVzdC5weQo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9TY3JpcHRzL3dlYmtpdHB5L2xh eW91dF90ZXN0cy9ydW5fd2Via2l0X3Rlc3RzX2ludGVncmF0aW9udGVzdC5weQkocmV2aXNpb24g MTYxMTMxKQorKysgVG9vbHMvU2NyaXB0cy93ZWJraXRweS9sYXlvdXRfdGVzdHMvcnVuX3dlYmtp dF90ZXN0c19pbnRlZ3JhdGlvbnRlc3QucHkJKHdvcmtpbmcgY29weSkKQEAgLTQ5Niw3ICs0OTYs NyBAQCBjbGFzcyBSdW5UZXN0KHVuaXR0ZXN0LlRlc3RDYXNlLCBTdHJlYW1UCiAgICAgICAgICAg ICB0ZXN0c19pbmNsdWRlZD1UcnVlLCBob3N0PWhvc3QpCiAgICAgICAgIGZpbGVfbGlzdCA9IGhv c3QuZmlsZXN5c3RlbS53cml0dGVuX2ZpbGVzLmtleXMoKQogICAgICAgICBzZWxmLmFzc2VydEVx dWFsKGRldGFpbHMuZXhpdF9jb2RlLCAxKQotICAgICAgICBleHBlY3RlZF90b2tlbiA9ICcidW5l eHBlY3RlZCI6eyJ0ZXh0LWltYWdlLWNoZWNrc3VtLmh0bWwiOnsiZXhwZWN0ZWQiOiJQQVNTIiwi YWN0dWFsIjoiSU1BR0UrVEVYVCIsImltYWdlX2RpZmZfcGVyY2VudCI6MX0sIm1pc3NpbmdfdGV4 dC5odG1sIjp7ImV4cGVjdGVkIjoiUEFTUyIsImlzX21pc3NpbmdfdGV4dCI6dHJ1ZSwiYWN0dWFs IjoiTUlTU0lORyJ9JworICAgICAgICBleHBlY3RlZF90b2tlbiA9ICcidW5leHBlY3RlZCI6eyJ0 ZXh0LWltYWdlLWNoZWNrc3VtLmh0bWwiOnsicmVwb3J0IjoiUkVHUkVTU0lPTiIsImV4cGVjdGVk IjoiUEFTUyIsImFjdHVhbCI6IklNQUdFK1RFWFQiLCJpbWFnZV9kaWZmX3BlcmNlbnQiOjF9LCJt aXNzaW5nX3RleHQuaHRtbCI6eyJyZXBvcnQiOiJNSVNTSU5HIiwiZXhwZWN0ZWQiOiJQQVNTIiwi aXNfbWlzc2luZ190ZXh0Ijp0cnVlLCJhY3R1YWwiOiJNSVNTSU5HIn0nCiAgICAgICAgIGpzb25f c3RyaW5nID0gaG9zdC5maWxlc3lzdGVtLnJlYWRfdGV4dF9maWxlKCcvdG1wL2xheW91dC10ZXN0 LXJlc3VsdHMvZnVsbF9yZXN1bHRzLmpzb24nKQogICAgICAgICBzZWxmLmFzc2VydFRydWUoanNv bl9zdHJpbmcuZmluZChleHBlY3RlZF90b2tlbikgIT0gLTEpCiAgICAgICAgIHNlbGYuYXNzZXJ0 VHJ1ZShqc29uX3N0cmluZy5maW5kKCcibnVtX3JlZ3Jlc3Npb25zIjoxJykgIT0gLTEpCkBAIC01 MTMsNyArNTEzLDcgQEAgY2xhc3MgUnVuVGVzdCh1bml0dGVzdC5UZXN0Q2FzZSwgU3RyZWFtVAog ICAgICAgICBkZXRhaWxzLCBlcnIsIF8gPSBsb2dnaW5nX3J1bihleHRyYV9hcmdzPWFyZ3MsIGhv c3Q9aG9zdCwgdGVzdHNfaW5jbHVkZWQ9VHJ1ZSkKIAogICAgICAgICBzZWxmLmFzc2VydEVxdWFs KGRldGFpbHMuZXhpdF9jb2RlLCAxKQotICAgICAgICBleHBlY3RlZF90b2tlbiA9ICcidW5leHBl Y3RlZCI6eyJwaXhlbGRpciI6eyJpbWFnZV9pbl9waXhlbGRpci5odG1sIjp7ImV4cGVjdGVkIjoi UEFTUyIsImFjdHVhbCI6IklNQUdFIicKKyAgICAgICAgZXhwZWN0ZWRfdG9rZW4gPSAnInVuZXhw ZWN0ZWQiOnsicGl4ZWxkaXIiOnsiaW1hZ2VfaW5fcGl4ZWxkaXIuaHRtbCI6eyJyZXBvcnQiOiJS RUdSRVNTSU9OIiwiZXhwZWN0ZWQiOiJQQVNTIiwiYWN0dWFsIjoiSU1BR0UiJwogICAgICAgICBq c29uX3N0cmluZyA9IGhvc3QuZmlsZXN5c3RlbS5yZWFkX3RleHRfZmlsZSgnL3RtcC9sYXlvdXQt dGVzdC1yZXN1bHRzL2Z1bGxfcmVzdWx0cy5qc29uJykKICAgICAgICAgc2VsZi5hc3NlcnRUcnVl KGpzb25fc3RyaW5nLmZpbmQoZXhwZWN0ZWRfdG9rZW4pICE9IC0xKQogCkBAIC01MzcsNyArNTM3 LDcgQEAgY2xhc3MgUnVuVGVzdCh1bml0dGVzdC5UZXN0Q2FzZSwgU3RyZWFtVAogICAgIGRlZiB0 ZXN0X2NyYXNoX3dpdGhfc3RkZXJyKHNlbGYpOgogICAgICAgICBob3N0ID0gTW9ja0hvc3QoKQog ICAgICAgICBfLCByZWd1bGFyX291dHB1dCwgXyA9IGxvZ2dpbmdfcnVuKFsnZmFpbHVyZXMvdW5l eHBlY3RlZC9jcmFzaC13aXRoLXN0ZGVyci5odG1sJ10sIHRlc3RzX2luY2x1ZGVkPVRydWUsIGhv c3Q9aG9zdCkKLSAgICAgICAgc2VsZi5hc3NlcnRUcnVlKGhvc3QuZmlsZXN5c3RlbS5yZWFkX3Rl eHRfZmlsZSgnL3RtcC9sYXlvdXQtdGVzdC1yZXN1bHRzL2Z1bGxfcmVzdWx0cy5qc29uJykuZmlu ZCgneyJjcmFzaC13aXRoLXN0ZGVyci5odG1sIjp7ImV4cGVjdGVkIjoiUEFTUyIsImFjdHVhbCI6 IkNSQVNIIiwiaGFzX3N0ZGVyciI6dHJ1ZX19JykgIT0gLTEpCisgICAgICAgIHNlbGYuYXNzZXJ0 VHJ1ZShob3N0LmZpbGVzeXN0ZW0ucmVhZF90ZXh0X2ZpbGUoJy90bXAvbGF5b3V0LXRlc3QtcmVz dWx0cy9mdWxsX3Jlc3VsdHMuanNvbicpLmZpbmQoJ3siY3Jhc2gtd2l0aC1zdGRlcnIuaHRtbCI6 eyJyZXBvcnQiOiJSRUdSRVNTSU9OIiwiZXhwZWN0ZWQiOiJQQVNTIiwiYWN0dWFsIjoiQ1JBU0gi LCJoYXNfc3RkZXJyIjp0cnVlfX0nKSAhPSAtMSkKIAogICAgIGRlZiB0ZXN0X25vX2ltYWdlX2Zh aWx1cmVfd2l0aF9pbWFnZV9kaWZmKHNlbGYpOgogICAgICAgICBob3N0ID0gTW9ja0hvc3QoKQpA QCAtNjY3LDcgKzY2Nyw3IEBAIGNsYXNzIFJ1blRlc3QodW5pdHRlc3QuVGVzdENhc2UsIFN0cmVh bVQKICAgICAgICAganNvbl9zdHJpbmcgPSBob3N0LmZpbGVzeXN0ZW0ucmVhZF90ZXh0X2ZpbGUo Jy90bXAvbGF5b3V0LXRlc3QtcmVzdWx0cy9mdWxsX3Jlc3VsdHMuanNvbicpCiAgICAgICAgIGpz b24gPSBwYXJzZV9mdWxsX3Jlc3VsdHMoanNvbl9zdHJpbmcpCiAgICAgICAgIHNlbGYuYXNzZXJ0 RXF1YWwoanNvblsidGVzdHMiXVsiZmFpbHVyZXMiXVsidW5leHBlY3RlZCJdWyJ0ZXh0LWltYWdl LWNoZWNrc3VtLmh0bWwiXSwKLSAgICAgICAgICAgIHsiZXhwZWN0ZWQiOiAiUEFTUyIsICJhY3R1 YWwiOiAiVEVYVCBJTUFHRStURVhUIiwgImltYWdlX2RpZmZfcGVyY2VudCI6IDF9KQorICAgICAg ICAgICAgeyJleHBlY3RlZCI6ICJQQVNTIiwgImFjdHVhbCI6ICJURVhUIElNQUdFK1RFWFQiLCAi aW1hZ2VfZGlmZl9wZXJjZW50IjogMSwgInJlcG9ydCI6ICJSRUdSRVNTSU9OIn0pCiAgICAgICAg IHNlbGYuYXNzZXJ0RmFsc2UoanNvblsicGl4ZWxfdGVzdHNfZW5hYmxlZCJdKQogICAgICAgICBz ZWxmLmFzc2VydEVxdWFsKGRldGFpbHMuZW5hYmxlZF9waXhlbF90ZXN0c19pbl9yZXRyeSwgVHJ1 ZSkKIApAQCAtNzQ5LDcgKzc0OSw3IEBAIGNsYXNzIFJ1blRlc3QodW5pdHRlc3QuVGVzdENhc2Us IFN0cmVhbVQKICAgICAgICAgaG9zdCA9IE1vY2tIb3N0KCkKICAgICAgICAgXywgZXJyLCBfID0g bG9nZ2luZ19ydW4oWyctLW5vLXNob3ctcmVzdWx0cycsICdyZWZ0ZXN0cy9mb28vJ10sIHRlc3Rz X2luY2x1ZGVkPVRydWUsIGhvc3Q9aG9zdCkKICAgICAgICAganNvbl9zdHJpbmcgPSBob3N0LmZp bGVzeXN0ZW0ucmVhZF90ZXh0X2ZpbGUoJy90bXAvbGF5b3V0LXRlc3QtcmVzdWx0cy9mdWxsX3Jl c3VsdHMuanNvbicpCi0gICAgICAgIHNlbGYuYXNzZXJ0VHJ1ZShqc29uX3N0cmluZy5maW5kKCci dW5saXN0ZWR0ZXN0Lmh0bWwiOnsiZXhwZWN0ZWQiOiJQQVNTIiwiaXNfbWlzc2luZ190ZXh0Ijp0 cnVlLCJhY3R1YWwiOiJNSVNTSU5HIiwiaXNfbWlzc2luZ19pbWFnZSI6dHJ1ZX0nKSAhPSAtMSkK KyAgICAgICAgc2VsZi5hc3NlcnRUcnVlKGpzb25fc3RyaW5nLmZpbmQoJyJ1bmxpc3RlZHRlc3Qu aHRtbCI6eyJyZXBvcnQiOiJNSVNTSU5HIiwiZXhwZWN0ZWQiOiJQQVNTIiwiaXNfbWlzc2luZ190 ZXh0Ijp0cnVlLCJhY3R1YWwiOiJNSVNTSU5HIiwiaXNfbWlzc2luZ19pbWFnZSI6dHJ1ZX0nKSAh PSAtMSkKICAgICAgICAgc2VsZi5hc3NlcnRUcnVlKGpzb25fc3RyaW5nLmZpbmQoJyJudW1fcmVn cmVzc2lvbnMiOjQnKSAhPSAtMSkKICAgICAgICAgc2VsZi5hc3NlcnRUcnVlKGpzb25fc3RyaW5n LmZpbmQoJyJudW1fZmxha3kiOjAnKSAhPSAtMSkKICAgICAgICAgc2VsZi5hc3NlcnRUcnVlKGpz b25fc3RyaW5nLmZpbmQoJyJudW1fbWlzc2luZyI6MScpICE9IC0xKQpAQCAtODUwLDExICs4NTAs MTEgQEAgY2xhc3MgRW5kVG9FbmRUZXN0KHVuaXR0ZXN0LlRlc3RDYXNlKToKICAgICAgICAgc2Vs Zi5hc3NlcnRUcnVlKCJtdWx0aXBsZS1taXNtYXRjaC1zdWNjZXNzLmh0bWwiIG5vdCBpbiBqc29u WyJ0ZXN0cyJdWyJyZWZ0ZXN0cyJdWyJmb28iXSkKICAgICAgICAgc2VsZi5hc3NlcnRUcnVlKCJt dWx0aXBsZS1ib3RoLXN1Y2Nlc3MuaHRtbCIgbm90IGluIGpzb25bInRlc3RzIl1bInJlZnRlc3Rz Il1bImZvbyJdKQogICAgICAgICBzZWxmLmFzc2VydEVxdWFsKGpzb25bInRlc3RzIl1bInJlZnRl c3RzIl1bImZvbyJdWyJtdWx0aXBsZS1tYXRjaC1mYWlsdXJlLmh0bWwiXSwKLSAgICAgICAgICAg IHsiZXhwZWN0ZWQiOiAiUEFTUyIsICJhY3R1YWwiOiAiSU1BR0UiLCAicmVmdGVzdF90eXBlIjog WyI9PSJdLCAiaW1hZ2VfZGlmZl9wZXJjZW50IjogMX0pCisgICAgICAgICAgICB7ImV4cGVjdGVk IjogIlBBU1MiLCAiYWN0dWFsIjogIklNQUdFIiwgInJlZnRlc3RfdHlwZSI6IFsiPT0iXSwgImlt YWdlX2RpZmZfcGVyY2VudCI6IDEsICJyZXBvcnQiOiAiUkVHUkVTU0lPTiJ9KQogICAgICAgICBz ZWxmLmFzc2VydEVxdWFsKGpzb25bInRlc3RzIl1bInJlZnRlc3RzIl1bImZvbyJdWyJtdWx0aXBs ZS1taXNtYXRjaC1mYWlsdXJlLmh0bWwiXSwKLSAgICAgICAgICAgIHsiZXhwZWN0ZWQiOiAiUEFT UyIsICJhY3R1YWwiOiAiSU1BR0UiLCAicmVmdGVzdF90eXBlIjogWyIhPSJdfSkKKyAgICAgICAg ICAgIHsiZXhwZWN0ZWQiOiAiUEFTUyIsICJhY3R1YWwiOiAiSU1BR0UiLCAicmVmdGVzdF90eXBl IjogWyIhPSJdLCAicmVwb3J0IjogIlJFR1JFU1NJT04ifSkKICAgICAgICAgc2VsZi5hc3NlcnRF cXVhbChqc29uWyJ0ZXN0cyJdWyJyZWZ0ZXN0cyJdWyJmb28iXVsibXVsdGlwbGUtYm90aC1mYWls dXJlLmh0bWwiXSwKLSAgICAgICAgICAgIHsiZXhwZWN0ZWQiOiAiUEFTUyIsICJhY3R1YWwiOiAi SU1BR0UiLCAicmVmdGVzdF90eXBlIjogWyI9PSIsICIhPSJdfSkKKyAgICAgICAgICAgIHsiZXhw ZWN0ZWQiOiAiUEFTUyIsICJhY3R1YWwiOiAiSU1BR0UiLCAicmVmdGVzdF90eXBlIjogWyI9PSIs ICIhPSJdLCAicmVwb3J0IjogIlJFR1JFU1NJT04ifSkKIAogCiBjbGFzcyBSZWJhc2VsaW5lVGVz dCh1bml0dGVzdC5UZXN0Q2FzZSwgU3RyZWFtVGVzdGluZ01peGluKToKSW5kZXg6IFRvb2xzL1Nj cmlwdHMvd2Via2l0cHkvbGF5b3V0X3Rlc3RzL21vZGVscy90ZXN0X3J1bl9yZXN1bHRzLnB5Cj09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT0KLS0tIFRvb2xzL1NjcmlwdHMvd2Via2l0cHkvbGF5b3V0X3Rlc3RzL21vZGVscy90 ZXN0X3J1bl9yZXN1bHRzLnB5CShyZXZpc2lvbiAxNjExMzEpCisrKyBUb29scy9TY3JpcHRzL3dl YmtpdHB5L2xheW91dF90ZXN0cy9tb2RlbHMvdGVzdF9ydW5fcmVzdWx0cy5weQkod29ya2luZyBj b3B5KQpAQCAtMTE3LDcgKzExNyw3IEBAIGRlZiBfaW50ZXJwcmV0X3Rlc3RfZmFpbHVyZXMoZmFp bHVyZXMpOgogCiAgICAgcmV0dXJuIHRlc3RfZGljdAogCi0KKyMgVGhlc2UgcmVzdWx0cyBtdXN0 IG1hdGNoIG9uZXMgaW4gcHJpbnRfdW5leHBlY3RlZF9yZXN1bHRzKCkgaW4gdmlld3MvYnVpbGRi b3RfcmVzdWx0cy5weS4KIGRlZiBzdW1tYXJpemVfcmVzdWx0cyhwb3J0X29iaiwgZXhwZWN0YXRp b25zLCBpbml0aWFsX3Jlc3VsdHMsIHJldHJ5X3Jlc3VsdHMsIGVuYWJsZWRfcGl4ZWxfdGVzdHNf aW5fcmV0cnksIGluY2x1ZGVfcGFzc2VzPUZhbHNlLCBpbmNsdWRlX3RpbWVfYW5kX21vZGlmaWVy cz1GYWxzZSk6CiAgICAgIiIiUmV0dXJucyBhIGRpY3Rpb25hcnkgY29udGFpbmluZyBhIHN1bW1h cnkgb2YgdGhlIHRlc3QgcnVucywgd2l0aCB0aGUgZm9sbG93aW5nIGZpZWxkczoKICAgICAgICAg J3ZlcnNpb24nOiBhIHZlcnNpb24gaW5kaWNhdG9yCkBAIC0xNzksMjUgKzE3OSwzMiBAQCBkZWYg c3VtbWFyaXplX3Jlc3VsdHMocG9ydF9vYmosIGV4cGVjdGF0CiAgICAgICAgIGVsaWYgcmVzdWx0 X3R5cGUgPT0gdGVzdF9leHBlY3RhdGlvbnMuQ1JBU0g6CiAgICAgICAgICAgICBpZiB0ZXN0X25h bWUgaW4gaW5pdGlhbF9yZXN1bHRzLnVuZXhwZWN0ZWRfcmVzdWx0c19ieV9uYW1lOgogICAgICAg ICAgICAgICAgIG51bV9yZWdyZXNzaW9ucyArPSAxCisgICAgICAgICAgICAgICAgdGVzdF9kaWN0 WydyZXBvcnQnXSA9ICdSRUdSRVNTSU9OJwogICAgICAgICBlbGlmIHJlc3VsdF90eXBlID09IHRl c3RfZXhwZWN0YXRpb25zLk1JU1NJTkc6CiAgICAgICAgICAgICBpZiB0ZXN0X25hbWUgaW4gaW5p dGlhbF9yZXN1bHRzLnVuZXhwZWN0ZWRfcmVzdWx0c19ieV9uYW1lOgogICAgICAgICAgICAgICAg IG51bV9taXNzaW5nICs9IDEKKyAgICAgICAgICAgICAgICB0ZXN0X2RpY3RbJ3JlcG9ydCddID0g J01JU1NJTkcnCiAgICAgICAgIGVsaWYgdGVzdF9uYW1lIGluIGluaXRpYWxfcmVzdWx0cy51bmV4 cGVjdGVkX3Jlc3VsdHNfYnlfbmFtZToKICAgICAgICAgICAgIGlmIHJldHJ5X3Jlc3VsdHMgYW5k IHRlc3RfbmFtZSBub3QgaW4gcmV0cnlfcmVzdWx0cy51bmV4cGVjdGVkX3Jlc3VsdHNfYnlfbmFt ZToKICAgICAgICAgICAgICAgICBhY3R1YWwuZXh0ZW5kKGV4cGVjdGF0aW9ucy5tb2RlbCgpLmdl dF9leHBlY3RhdGlvbnNfc3RyaW5nKHRlc3RfbmFtZSkuc3BsaXQoIiAiKSkKICAgICAgICAgICAg ICAgICBudW1fZmxha3kgKz0gMQorICAgICAgICAgICAgICAgIHRlc3RfZGljdFsncmVwb3J0J10g PSAnRkxBS1knCiAgICAgICAgICAgICBlbGlmIHJldHJ5X3Jlc3VsdHM6CiAgICAgICAgICAgICAg ICAgcmV0cnlfcmVzdWx0X3R5cGUgPSByZXRyeV9yZXN1bHRzLnVuZXhwZWN0ZWRfcmVzdWx0c19i eV9uYW1lW3Rlc3RfbmFtZV0udHlwZQogICAgICAgICAgICAgICAgIGlmIHJlc3VsdF90eXBlICE9 IHJldHJ5X3Jlc3VsdF90eXBlOgogICAgICAgICAgICAgICAgICAgICBpZiBlbmFibGVkX3BpeGVs X3Rlc3RzX2luX3JldHJ5IGFuZCByZXN1bHRfdHlwZSA9PSB0ZXN0X2V4cGVjdGF0aW9ucy5URVhU IGFuZCByZXRyeV9yZXN1bHRfdHlwZSA9PSB0ZXN0X2V4cGVjdGF0aW9ucy5JTUFHRV9QTFVTX1RF WFQ6CiAgICAgICAgICAgICAgICAgICAgICAgICBudW1fcmVncmVzc2lvbnMgKz0gMQorICAgICAg ICAgICAgICAgICAgICAgICAgdGVzdF9kaWN0WydyZXBvcnQnXSA9ICdSRUdSRVNTSU9OJwogICAg ICAgICAgICAgICAgICAgICBlbHNlOgogICAgICAgICAgICAgICAgICAgICAgICAgbnVtX2ZsYWt5 ICs9IDEKKyAgICAgICAgICAgICAgICAgICAgICAgIHRlc3RfZGljdFsncmVwb3J0J10gPSAnRkxB S1knCiAgICAgICAgICAgICAgICAgICAgIGFjdHVhbC5hcHBlbmQoa2V5d29yZHNbcmV0cnlfcmVz dWx0X3R5cGVdKQogICAgICAgICAgICAgICAgIGVsc2U6CiAgICAgICAgICAgICAgICAgICAgIG51 bV9yZWdyZXNzaW9ucyArPSAxCisgICAgICAgICAgICAgICAgICAgIHRlc3RfZGljdFsncmVwb3J0 J10gPSAnUkVHUkVTU0lPTicKICAgICAgICAgICAgIGVsc2U6CiAgICAgICAgICAgICAgICAgbnVt X3JlZ3Jlc3Npb25zICs9IDEKKyAgICAgICAgICAgICAgICB0ZXN0X2RpY3RbJ3JlcG9ydCddID0g J1JFR1JFU1NJT04nCiAKICAgICAgICAgdGVzdF9kaWN0WydleHBlY3RlZCddID0gZXhwZWN0ZWQK ICAgICAgICAgdGVzdF9kaWN0WydhY3R1YWwnXSA9ICIgIi5qb2luKGFjdHVhbCkKSW5kZXg6IFRv b2xzL1NjcmlwdHMvd2Via2l0cHkvbGF5b3V0X3Rlc3RzL3ZpZXdzL2J1aWxkYm90X3Jlc3VsdHMu cHkKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PQotLS0gVG9vbHMvU2NyaXB0cy93ZWJraXRweS9sYXlvdXRfdGVzdHMvdmll d3MvYnVpbGRib3RfcmVzdWx0cy5weQkocmV2aXNpb24gMTYxMTMxKQorKysgVG9vbHMvU2NyaXB0 cy93ZWJraXRweS9sYXlvdXRfdGVzdHMvdmlld3MvYnVpbGRib3RfcmVzdWx0cy5weQkod29ya2lu ZyBjb3B5KQpAQCAtODgsNiArODgsNyBAQCBjbGFzcyBCdWlsZEJvdFByaW50ZXIob2JqZWN0KToK ICAgICAgICAgICAgICAgICBwY3QgPSBsZW4ocmVzdWx0cykgKiAxMDAuMCAvIG5vdF9wYXNzaW5n CiAgICAgICAgICAgICAgICAgc2VsZi5fcHJpbnQoIiAgJTVkICUtMjRzICglNC4xZiUlKSIgJSAo bGVuKHJlc3VsdHMpLCBkZXNjLCBwY3QpKQogCisgICAgIyBUaGVzZSByZXN1bHRzIG11c3QgbWF0 Y2ggb25lcyBpbiBzdW1tYXJpemVfcmVzdWx0cygpIGluIG1vZGVscy90ZXN0X3J1bl9yZXN1bHRz LnB5LgogICAgIGRlZiBwcmludF91bmV4cGVjdGVkX3Jlc3VsdHMoc2VsZiwgc3VtbWFyaXplZF9y ZXN1bHRzLCBlbmFibGVkX3BpeGVsX3Rlc3RzX2luX3JldHJ5PUZhbHNlKToKICAgICAgICAgcGFz c2VzID0ge30KICAgICAgICAgZmxha3kgPSB7fQo=