124496 2013-11-18 05:05:57 -0800 Simplify and reformat the output of performance tests inside test runners 2013-11-19 18:54:07 -0800 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) Unspecified Unspecified RESOLVED FIXED P2 Normal --- 124495 124499 124623 1 rniwa rniwa andersca benjamin commit-queue glenn kling koivisto oldest_to_newest 951580 0 rniwa 2013-11-18 05:05:57 -0800 We should dramatically streamline the raw output of performance tests in order to support subtests. 951592 1 217194 rniwa 2013-11-18 06:51:07 -0800 Created attachment 217194 Patch 951840 2 217194 commit-queue 2013-11-18 15:38:16 -0800 Comment on attachment 217194 Patch Clearing flags on attachment: 217194 Committed r159465: <http://trac.webkit.org/changeset/159465> 951841 3 commit-queue 2013-11-18 15:38:18 -0800 All reviewed patches have been landed. Closing bug. 952091 4 217194 darin 2013-11-19 09:17:21 -0800 Comment on attachment 217194 Patch View in context: https://bugs.webkit.org/attachment.cgi?id=217194&action=review > PerformanceTests/ChangeLog:32 > + getAttribute -> [1105, 1108, 1134, 1137, 1154] > + element.property -> [1634, 1655, 1685, 1696, 1723] > + setAttribute -> [646.3536463536464, 651, 651, 656.3436563436563, 658] > + element.property = value -> [934, 949, 963, 964, 974] > + element.expando = value -> [419, 419.5804195804196, 421.57842157842157, 425.57442557442556, 429] > + element.expando -> [501, 517, 519.4805194805194, 521.4785214785214, 525] > + > + 1: 117.40644785571585 runs/s > + 2: 118.84720469666297 runs/s > + 3: 119.80547640905021 runs/s > + 4: 120.51886194758805 runs/s > + 5: 121.51924380569295 runs/s > + > + :Time -> [117.40644785571585, 118.84720469666297, 119.80547640905021, 120.51886194758805, 121.51924380569295] runs/s > + mean: 119.619446942942 runs/s > + median: 119.80547640905021 runs/s > + stdev: 1.5769040458730506 runs/s > + min: 117.40644785571585 runs/s > + max: 121.51924380569295 runs/s This is showing numbers with precision that is not justified by the precision of our ability to measure. At some point we should fix to round so we don’t display so many meaningless digits. 952377 5 rniwa 2013-11-19 18:54:07 -0800 (In reply to comment #4) > (From update of attachment 217194 [details]) > View in context: https://bugs.webkit.org/attachment.cgi?id=217194&action=review > > This is showing numbers with precision that is not justified by the precision of our ability to measure. At some point we should fix to round so we don’t display so many meaningless digits. That involves computing the confidence interval and computing the appropriate precision. This is tracked by https://bugs.webkit.org/show_bug.cgi?id=100037. 217194 2013-11-18 06:51:07 -0800 2013-11-19 09:17:21 -0800 Patch bug-124496-20131118235106.patch text/plain 22817 rniwa U3VidmVyc2lvbiBSZXZpc2lvbjogMTU4OTAxCmRpZmYgLS1naXQgYS9Ub29scy9DaGFuZ2VMb2cg Yi9Ub29scy9DaGFuZ2VMb2cKaW5kZXggNWQ3OGUzOTg0MmMyM2U2MWRkNGNjNzA3NjExMjdjOWFi ZGQ0ZTcxMi4uMjY4MzQ4YTM3YzdmYmY3M2NhMTE4YWUyOGIxMzNjYWMyMzUzNGQ5MiAxMDA2NDQK LS0tIGEvVG9vbHMvQ2hhbmdlTG9nCisrKyBiL1Rvb2xzL0NoYW5nZUxvZwpAQCAtMSwzICsxLDQ2 IEBACisyMDEzLTExLTE4ICBSeW9zdWtlIE5pd2EgIDxybml3YUB3ZWJraXQub3JnPgorCisgICAg ICAgIFNpbXBsaWZ5IGFuZCByZWZvcm1hdCB0aGUgb3V0cHV0IG9mIHBlcmZvcm1hbmNlIHRlc3Rz IGluc2lkZSB0ZXN0IHJ1bm5lcnMKKyAgICAgICAgaHR0cHM6Ly9idWdzLndlYmtpdC5vcmcvc2hv d19idWcuY2dpP2lkPTEyNDQ5NgorCisgICAgICAgIFJldmlld2VkIGJ5IE5PQk9EWSAoT09QUyEp LgorCisgICAgICAgIEFzIGEgcHJlcGFyYXRpb24gdG8gc3VwcG9ydCBzdWJ0ZXN0cyBmb3IgRHJv bWFlbyBhbmQgRG9Zb3VFdmVuQmVuY2gsIHNpbXBsaWZ5IHRoZSBvdXRwdXQKKyAgICAgICAgcGVy Zm9ybWFuY2UgdGVzdHMgZ2VuZXJhdGUuIEluc3RlYWQgb2Ygc3BpdHRpbmcgb3V0IG5vaXNlIGlu IFBlcmZUZXN0UnVubmVyIChydW5uZXIuanMpCisgICAgICAgIGFuZCBpZ25vcmluZyBpdCBpbiBQ ZXJmVGVzdC5fZmlsdGVyX291dHB1dCAocGVyZnRlc3QucHkpLCBzaW1wbHkgYXZvaWQgZ2VuZXJh dGluZyBpdCBpbgorICAgICAgICB0aGUgZmlyc3QgcGxhY2UuCisKKyAgICAgICAgQWxzbyBtb2Rl cm5pemUgdGhlIG91dHB1dCB0byBhZG9wdCAibWV0cmljIiBjb25jZXB0IGJldHRlciBhbmQgbWFr ZSBpdCBmb3J3YXJkIGNvbXBhdGlibGUKKyAgICAgICAgd2l0aCBzdWJ0ZXN0cy4KKworICAgICAg ICBXaXRoIHRoaXMgcGF0Y2gsIHBlcmZvcm1hbmNlIHRlc3RzIHdyaXR0ZW4gdXNpbmcgcnVubmVy LmpzIG9ubHkgcHJvZHVjZXMgZW1wdHkgbGluZXMgb3IKKyAgICAgICAgbGluZXMgb2YgdGhlIGZv bGxvd2luZyBmb3JtYXQgaW5zaWRlIHRlc3QgcnVubmVycyAoRHVtcFJlbmRlclRyZWUgYW5kIFdl YktpdFRlc3RSdW5uZXIpOgorICAgICAgICA8c3VidGVzdCBuYW1lPiAtPiBbPHZhbHVlIDE+LCA8 dmFsdWUgMj4sIC4uLl0KKyAgICAgICAgOjxtZXRyaWMgbmFtZT4gLT4gWzx2YWx1ZSAxPiwgPHZh bHVlIDI+LCAuLi5dCisKKyAgICAgICAgVGhpcyBncmVhdGx5IHNpbXBsaWZpZXMgdGhlIHBhcnNp bmcgbG9naWMgaW5zaWRlIFBlcmZUZXN0Ll9ydW5fd2l0aF9kcml2ZXIuCisKKyAgICAgICAgKiBT Y3JpcHRzL3dlYmtpdHB5L3BlcmZvcm1hbmNlX3Rlc3RzL3BlcmZ0ZXN0LnB5OgorICAgICAgICAo UGVyZlRlc3QpOiBSZW1vdmVkIGEgYnVuY2ggb2YgcmVndWxhciBleHByZXNzaW9ucyB0aGF0IGFy ZSBubyBsb25nZXIgdXNlZC4KKyAgICAgICAgKFBlcmZUZXN0Ll9ydW5fd2l0aF9kcml2ZXIpOiBK dXN0IHBhcnNlIHRoZSB2YWx1ZXMgYW5kIGRlc2NyaXB0aW9uIGFuZCB0cmVhdCBldmVyeXRoaW5n CisgICAgICAgIGVsc2UgYXMgZXJyb3JzLgorCisgICAgICAgICogU2NyaXB0cy93ZWJraXRweS9w ZXJmb3JtYW5jZV90ZXN0cy9wZXJmdGVzdF91bml0dGVzdC5weToKKyAgICAgICAgKFRlc3RQZXJm VGVzdC50ZXN0X3BhcnNlX291dHB1dCk6IFJlbW92ZWQgdGhlIGp1bmsuCisgICAgICAgIChUZXN0 UGVyZlRlc3QuX2Fzc2VydF9mYWlsZWRfb25fbGluZSk6IEV4dHJhY3RlZCBmcm9tIHRlc3RfcGFy c2Vfb3V0cHV0X3dpdGhfZmFpbGluZ19saW5lLAorICAgICAgICB3aGljaCB3YXMgcmVtb3ZlZCBp biBmYXZvciBvZiB0aGUgdGVzdHMgYmVsb3cuCisgICAgICAgIChUZXN0UGVyZlRlc3QudGVzdF9w YXJzZV9vdXRwdXRfd2l0aF9ydW5uaW5nX2ZpdmVfdGltZXMpOiBBZGRlZC4KKyAgICAgICAgKFRl c3RQZXJmVGVzdC50ZXN0X3BhcnNlX291dHB1dF93aXRoX2RldGFpbGVkX2luZm8pOiBBZGRlZC4K KyAgICAgICAgKFRlc3RQZXJmVGVzdC50ZXN0X3BhcnNlX291dHB1dF93aXRoX3N0YXRpc3RpY3Mp OiBBZGRlZC4KKyAgICAgICAgKFRlc3RQZXJmVGVzdC50ZXN0X3BhcnNlX291dHB1dF93aXRoX2Rl c2NyaXB0aW9uKTogUmVtb3ZlZCB0aGUganVuay4KKyAgICAgICAgKFRlc3RQZXJmVGVzdC50ZXN0 X3BhcnNlX291dHB1dF93aXRoX3N1YnRlc3RzKTogRGl0dG8uCisgICAgICAgIChUZXN0U2luZ2xl UHJvY2Vzc1BlcmZUZXN0LnRlc3RfdXNlX29ubHlfb25lX3Byb2Nlc3MpOiBEaXR0by4KKworICAg ICAgICAqIFNjcmlwdHMvd2Via2l0cHkvcGVyZm9ybWFuY2VfdGVzdHMvcGVyZnRlc3RzcnVubmVy X2ludGVncmF0aW9udGVzdC5weToKKyAgICAgICAgKEV2ZW50VGFyZ2V0V3JhcHBlclRlc3REYXRh KTogRGl0dG8uCisgICAgICAgIChTb21lUGFyc2VyVGVzdERhdGEpOiBEaXR0by4KKyAgICAgICAg KE1lbW9yeVRlc3REYXRhKTogRGl0dG8uCisKIDIwMTMtMTEtMDcgIENocmlzIEZsZWl6YWNoICA8 Y2ZsZWl6YWNoQGFwcGxlLmNvbT4KIAogICAgICAgICBNb2RpZnkgZW1haWwgb3JkZXIgbGlzdCBm b3IgSmFtZXMgQ3JhaWcgc28gaGlzIHByaW1hcnkgZW1haWwgaXMgZmlyc3QuCmRpZmYgLS1naXQg YS9Ub29scy9TY3JpcHRzL3dlYmtpdHB5L3BlcmZvcm1hbmNlX3Rlc3RzL3BlcmZ0ZXN0LnB5IGIv VG9vbHMvU2NyaXB0cy93ZWJraXRweS9wZXJmb3JtYW5jZV90ZXN0cy9wZXJmdGVzdC5weQppbmRl eCAwZGYzY2MwZWFmM2FkZWFhOWIwMjFkYWIyNGZlYmMwYTI1YWQ5MDE4Li40YjgwZjFlOTEyM2Y5 ZmMzMWNhMWFkMmJmMzE2YWZiYzYyNjM5YTE3IDEwMDY0NAotLS0gYS9Ub29scy9TY3JpcHRzL3dl YmtpdHB5L3BlcmZvcm1hbmNlX3Rlc3RzL3BlcmZ0ZXN0LnB5CisrKyBiL1Rvb2xzL1NjcmlwdHMv d2Via2l0cHkvcGVyZm9ybWFuY2VfdGVzdHMvcGVyZnRlc3QucHkKQEAgLTEsNCArMSw1IEBACi0j IENvcHlyaWdodCAoQykgMjAxMiBHb29nbGUgSW5jLiBBbGwgcmlnaHRzIHJlc2VydmVkLgorIyBD b3B5cmlnaHQgKEMpIDIwMTIsIDIwMTMgQXBwbGUgSW5jLiBBbGwgcmlnaHRzIHJlc2VydmVkLgor IyBDb3B5cmlnaHQgKEMpIDIwMTIsIDIwMTMgR29vZ2xlIEluYy4gQWxsIHJpZ2h0cyByZXNlcnZl ZC4KICMgQ29weXJpZ2h0IChDKSAyMDEyIFpvbHRhbiBIb3J2YXRoLCBBZG9iZSBTeXN0ZW1zIElu Y29ycG9yYXRlZC4gQWxsIHJpZ2h0cyByZXNlcnZlZC4KICMKICMgUmVkaXN0cmlidXRpb24gYW5k IHVzZSBpbiBzb3VyY2UgYW5kIGJpbmFyeSBmb3Jtcywgd2l0aCBvciB3aXRob3V0CkBAIC0xNjUs OSArMTY2LDcgQEAgY2xhc3MgUGVyZlRlc3Qob2JqZWN0KToKICAgICAgICAgICAgIChtZWRpYW4s IHVuaXQsIHN0ZGV2LCB1bml0LCBzb3J0ZWRfdmFsdWVzWzBdLCB1bml0LCBzb3J0ZWRfdmFsdWVz Wy0xXSwgdW5pdCkpCiAKICAgICBfZGVzY3JpcHRpb25fcmVnZXggPSByZS5jb21waWxlKHInXkRl c2NyaXB0aW9uOiAoP1A8ZGVzY3JpcHRpb24+LiopJCcsIHJlLklHTk9SRUNBU0UpCi0gICAgX21l dHJpY3NfcmVnZXggPSByZS5jb21waWxlKHInXig/UDxtZXRyaWM+VGltZXxNYWxsb2N8SlMgSGVh cCk6JykKLSAgICBfc3RhdGlzdGljc19rZXlzID0gWydhdmcnLCAnbWVkaWFuJywgJ3N0ZGV2Jywg J21pbicsICdtYXgnLCAndW5pdCcsICd2YWx1ZXMnXQotICAgIF9zY29yZV9yZWdleCA9IHJlLmNv bXBpbGUocideKD9QPGtleT4nICsgcid8Jy5qb2luKF9zdGF0aXN0aWNzX2tleXMpICsgcicpXHMr KD9QPHZhbHVlPihbMC05XC5dKygsXHMrKT8pKylccyooP1A8dW5pdD4uKiknKQorICAgIF9tZXRy aWNzX3JlZ2V4ID0gcmUuY29tcGlsZShyJ146KD9QPG1ldHJpYz5UaW1lfE1hbGxvY3xKU0hlYXAp IC0+IFxbKD9QPHZhbHVlcz4oXGQrKFwuXGQrKT8pKCwgXGQrKFwuXGQrKT8pKylcXSAoP1A8dW5p dD5bYS16L10rKScpCiAKICAgICBkZWYgX3J1bl93aXRoX2RyaXZlcihzZWxmLCBkcml2ZXIsIHRp bWVfb3V0X21zKToKICAgICAgICAgb3V0cHV0ID0gc2VsZi5ydW5fc2luZ2xlKGRyaXZlciwgc2Vs Zi50ZXN0X3BhdGgoKSwgdGltZV9vdXRfbXMpCkBAIC0xNzgsMjMgKzE3NywxOCBAQCBjbGFzcyBQ ZXJmVGVzdChvYmplY3QpOgogICAgICAgICBjdXJyZW50X21ldHJpYyA9IE5vbmUKICAgICAgICAg Zm9yIGxpbmUgaW4gcmUuc3BsaXQoJ1xuJywgb3V0cHV0LnRleHQpOgogICAgICAgICAgICAgZGVz Y3JpcHRpb25fbWF0Y2ggPSBzZWxmLl9kZXNjcmlwdGlvbl9yZWdleC5tYXRjaChsaW5lKQotICAg ICAgICAgICAgbWV0cmljX21hdGNoID0gc2VsZi5fbWV0cmljc19yZWdleC5tYXRjaChsaW5lKQot ICAgICAgICAgICAgc2NvcmUgPSBzZWxmLl9zY29yZV9yZWdleC5tYXRjaChsaW5lKQotCiAgICAg ICAgICAgICBpZiBkZXNjcmlwdGlvbl9tYXRjaDoKICAgICAgICAgICAgICAgICBzZWxmLl9kZXNj cmlwdGlvbiA9IGRlc2NyaXB0aW9uX21hdGNoLmdyb3VwKCdkZXNjcmlwdGlvbicpCi0gICAgICAg ICAgICBlbGlmIG1ldHJpY19tYXRjaDoKLSAgICAgICAgICAgICAgICBjdXJyZW50X21ldHJpYyA9 IG1ldHJpY19tYXRjaC5ncm91cCgnbWV0cmljJykucmVwbGFjZSgnICcsICcnKQotICAgICAgICAg ICAgZWxpZiBzY29yZToKLSAgICAgICAgICAgICAgICBpZiBzY29yZS5ncm91cCgna2V5JykgIT0g J3ZhbHVlcyc6Ci0gICAgICAgICAgICAgICAgICAgIGNvbnRpbnVlCi0KLSAgICAgICAgICAgICAg ICBtZXRyaWMgPSBzZWxmLl9lbnN1cmVfbWV0cmljcyhjdXJyZW50X21ldHJpYywgc2NvcmUuZ3Jv dXAoJ3VuaXQnKSkKLSAgICAgICAgICAgICAgICBtZXRyaWMuYXBwZW5kX2dyb3VwKG1hcChsYW1i ZGEgdmFsdWU6IGZsb2F0KHZhbHVlKSwgc2NvcmUuZ3JvdXAoJ3ZhbHVlJykuc3BsaXQoJywgJykp KQotICAgICAgICAgICAgZWxzZToKKyAgICAgICAgICAgICAgICBjb250aW51ZQorCisgICAgICAg ICAgICBtZXRyaWNfbWF0Y2ggPSBzZWxmLl9tZXRyaWNzX3JlZ2V4Lm1hdGNoKGxpbmUpCisgICAg ICAgICAgICBpZiBub3QgbWV0cmljX21hdGNoOgogICAgICAgICAgICAgICAgIF9sb2cuZXJyb3Io J0VSUk9SOiAnICsgbGluZSkKICAgICAgICAgICAgICAgICByZXR1cm4gRmFsc2UKIAorICAgICAg ICAgICAgbWV0cmljID0gc2VsZi5fZW5zdXJlX21ldHJpY3MobWV0cmljX21hdGNoLmdyb3VwKCdt ZXRyaWMnKSwgbWV0cmljX21hdGNoLmdyb3VwKCd1bml0JykpCisgICAgICAgICAgICBtZXRyaWMu YXBwZW5kX2dyb3VwKG1hcChsYW1iZGEgdmFsdWU6IGZsb2F0KHZhbHVlKSwgbWV0cmljX21hdGNo Lmdyb3VwKCd2YWx1ZXMnKS5zcGxpdCgnLCAnKSkpCisKICAgICAgICAgcmV0dXJuIFRydWUKIAog ICAgIGRlZiBfZW5zdXJlX21ldHJpY3Moc2VsZiwgbWV0cmljX25hbWUsIHVuaXQ9Tm9uZSk6CkBA IC0yNDAsMTAgKzIzNCw2IEBAIGNsYXNzIFBlcmZUZXN0KG9iamVjdCk6CiAgICAgXQogCiAgICAg X2xpbmVzX3RvX2lnbm9yZV9pbl9wYXJzZXJfcmVzdWx0ID0gWwotICAgICAgICByZS5jb21waWxl KHInXlJ1bm5pbmcgXGQrIHRpbWVzJCcpLAotICAgICAgICByZS5jb21waWxlKHInXklnbm9yaW5n IHdhcm0tdXAgJyksCi0gICAgICAgIHJlLmNvbXBpbGUocideSW5mbzonKSwKLSAgICAgICAgcmUu Y29tcGlsZShyJ15cZCsoLlxkKyk/KFxzKihydW5zXC9zfG1zfGZwcykpPyQnKSwKICAgICAgICAg IyBGb2xsb3dpbmcgYXJlIGZvciBoYW5kbGUgZXhpc3RpbmcgdGVzdCBsaWtlIERyb21hZW8KICAg ICAgICAgcmUuY29tcGlsZShyZS5lc2NhcGUoIiIibWFpbiBmcmFtZSAtIGhhcyAxIG9udW5sb2Fk IGhhbmRsZXIocykiIiIpKSwKICAgICAgICAgcmUuY29tcGlsZShyZS5lc2NhcGUoIiIiZnJhbWUg IjwhLS1mcmFtZVBhdGggLy88IS0tZnJhbWUwLS0+LS0+IiAtIGhhcyAxIG9udW5sb2FkIGhhbmRs ZXIocykiIiIpKSwKQEAgLTI1Myw3ICsyNDMsOCBAQCBjbGFzcyBQZXJmVGVzdChvYmplY3QpOgog ICAgICAgICByZS5jb21waWxlKHIiQ09OU09MRSBNRVNTQUdFOiAobGluZSBcZCs6ICk/QmxvY2tl ZCBzY3JpcHQgZXhlY3V0aW9uIGluICdbQS1aYS16MC05XC1cLjpdKycgYmVjYXVzZSB0aGUgZG9j dW1lbnQncyBmcmFtZSBpcyBzYW5kYm94ZWQgYW5kIHRoZSAnYWxsb3ctc2NyaXB0cycgcGVybWlz c2lvbiBpcyBub3Qgc2V0LiIpLAogICAgICAgICByZS5jb21waWxlKHIiQ09OU09MRSBNRVNTQUdF OiAobGluZSBcZCs6ICk/Tm90IGFsbG93ZWQgdG8gbG9hZCBsb2NhbCByZXNvdXJjZSIpLAogICAg ICAgICAjIERyb21hZW8gcmVwb3J0cyB2YWx1ZXMgZm9yIHN1YnRlc3RzLiBJZ25vcmUgdGhlbSBm b3Igbm93LgotICAgICAgICByZS5jb21waWxlKHInKD9QPG5hbWU+LispOiBcWyg/UDx2YWx1ZXM+ KFxkKyguXGQrKT8sXHMrKSpcZCsoLlxkKyk/KVxdJyksCisgICAgICAgICMgRklYTUU6IFJlbW92 ZSBvbmNlIHN1YnRlc3RzIGFyZSBzdXBwb3J0ZWQKKyAgICAgICAgcmUuY29tcGlsZShyJ15bQS1a YS16MC05XC4gPV0rKCAtPiApKFxbP1swLTlcLiwgXStcXSkoIFthLXovXSspPyQnKSwKICAgICBd CiAKICAgICBkZWYgX2ZpbHRlcl9vdXRwdXQoc2VsZiwgb3V0cHV0KToKZGlmZiAtLWdpdCBhL1Rv b2xzL1NjcmlwdHMvd2Via2l0cHkvcGVyZm9ybWFuY2VfdGVzdHMvcGVyZnRlc3RfdW5pdHRlc3Qu cHkgYi9Ub29scy9TY3JpcHRzL3dlYmtpdHB5L3BlcmZvcm1hbmNlX3Rlc3RzL3BlcmZ0ZXN0X3Vu aXR0ZXN0LnB5CmluZGV4IGI5MDRiOTc2MGFmOTgzYTM4YWYzMTg2NjVlYTNlMTQ1MGEyZWIyNjEu LjU3OWFjMTdjNjVlZmNjNTQzY2I1OWRjZTQ2MTUwMWMyNmFmMjYwYjEgMTAwNjQ0Ci0tLSBhL1Rv b2xzL1NjcmlwdHMvd2Via2l0cHkvcGVyZm9ybWFuY2VfdGVzdHMvcGVyZnRlc3RfdW5pdHRlc3Qu cHkKKysrIGIvVG9vbHMvU2NyaXB0cy93ZWJraXRweS9wZXJmb3JtYW5jZV90ZXN0cy9wZXJmdGVz dF91bml0dGVzdC5weQpAQCAtOTgsMTYgKzk4LDcgQEAgY2xhc3MgVGVzdFBlcmZUZXN0KHVuaXR0 ZXN0LlRlc3RDYXNlKToKIAogICAgIGRlZiB0ZXN0X3BhcnNlX291dHB1dChzZWxmKToKICAgICAg ICAgb3V0cHV0ID0gRHJpdmVyT3V0cHV0KCIiIgotUnVubmluZyAyMCB0aW1lcwotSWdub3Jpbmcg d2FybS11cCBydW4gKDExMTUpCi0KLVRpbWU6Ci12YWx1ZXMgMTA4MCwgMTEyMCwgMTA5NSwgMTEw MSwgMTEwNCBtcwotYXZnIDExMDAgbXMKLW1lZGlhbiAxMTAxIG1zCi1zdGRldiAxNC41MDg2MiBt cwotbWluIDEwODAgbXMKLW1heCAxMTIwIG1zCis6VGltZSAtPiBbMTA4MCwgMTEyMCwgMTA5NSwg MTEwMSwgMTEwNF0gbXMKICIiIiwgaW1hZ2U9Tm9uZSwgaW1hZ2VfaGFzaD1Ob25lLCBhdWRpbz1O b25lKQogICAgICAgICBvdXRwdXRfY2FwdHVyZSA9IE91dHB1dENhcHR1cmUoKQogICAgICAgICBv dXRwdXRfY2FwdHVyZS5jYXB0dXJlX291dHB1dCgpCkBAIC0xMjAsMjEgKzExMSw4IEBAIG1heCAx MTIwIG1zCiAgICAgICAgIHNlbGYuYXNzZXJ0RXF1YWwoYWN0dWFsX3N0ZGVyciwgJycpCiAgICAg ICAgIHNlbGYuYXNzZXJ0RXF1YWwoYWN0dWFsX2xvZ3MsICcnKQogCi0gICAgZGVmIHRlc3RfcGFy c2Vfb3V0cHV0X3dpdGhfZmFpbGluZ19saW5lKHNlbGYpOgotICAgICAgICBvdXRwdXQgPSBEcml2 ZXJPdXRwdXQoIiIiCi1SdW5uaW5nIDIwIHRpbWVzCi1JZ25vcmluZyB3YXJtLXVwIHJ1biAoMTEx NSkKLQotc29tZS11bnJlY29nbml6YWJsZS1saW5lCi0KLVRpbWU6Ci12YWx1ZXMgMTA4MCwgMTEy MCwgMTA5NSwgMTEwMSwgMTEwNCBtcwotYXZnIDExMDAgbXMKLW1lZGlhbiAxMTAxIG1zCi1zdGRl diAxNC41MDg2MiBtcwotbWluIDEwODAgbXMKLW1heCAxMTIwIG1zCi0iIiIsIGltYWdlPU5vbmUs IGltYWdlX2hhc2g9Tm9uZSwgYXVkaW89Tm9uZSkKKyAgICBkZWYgX2Fzc2VydF9mYWlsZWRfb25f bGluZShzZWxmLCBvdXRwdXRfdGV4dCwgZXhwZWN0ZWRfbG9nKToKKyAgICAgICAgb3V0cHV0ID0g RHJpdmVyT3V0cHV0KG91dHB1dF90ZXh0LCBpbWFnZT1Ob25lLCBpbWFnZV9oYXNoPU5vbmUsIGF1 ZGlvPU5vbmUpCiAgICAgICAgIG91dHB1dF9jYXB0dXJlID0gT3V0cHV0Q2FwdHVyZSgpCiAgICAg ICAgIG91dHB1dF9jYXB0dXJlLmNhcHR1cmVfb3V0cHV0KCkKICAgICAgICAgdHJ5OgpAQCAtMTQ1 LDIyICsxMjMsMzIgQEAgbWF4IDExMjAgbXMKICAgICAgICAgICAgIGFjdHVhbF9zdGRvdXQsIGFj dHVhbF9zdGRlcnIsIGFjdHVhbF9sb2dzID0gb3V0cHV0X2NhcHR1cmUucmVzdG9yZV9vdXRwdXQo KQogICAgICAgICBzZWxmLmFzc2VydEVxdWFsKGFjdHVhbF9zdGRvdXQsICcnKQogICAgICAgICBz ZWxmLmFzc2VydEVxdWFsKGFjdHVhbF9zdGRlcnIsICcnKQotICAgICAgICBzZWxmLmFzc2VydEVx dWFsKGFjdHVhbF9sb2dzLCAnRVJST1I6IHNvbWUtdW5yZWNvZ25pemFibGUtbGluZVxuJykKKyAg ICAgICAgc2VsZi5hc3NlcnRFcXVhbChhY3R1YWxfbG9ncywgZXhwZWN0ZWRfbG9nKQorCisgICAg ZGVmIHRlc3RfcGFyc2Vfb3V0cHV0X3dpdGhfcnVubmluZ19maXZlX3RpbWVzKHNlbGYpOgorICAg ICAgICBzZWxmLl9hc3NlcnRfZmFpbGVkX29uX2xpbmUoIiIiCitSdW5uaW5nIDUgdGltZXMKKzpU aW1lIC0+IFsxMDgwLCAxMTIwLCAxMDk1LCAxMTAxLCAxMTA0XSBtcworIiIiLCAnRVJST1I6IFJ1 bm5pbmcgNSB0aW1lc1xuJykKKworICAgIGRlZiB0ZXN0X3BhcnNlX291dHB1dF93aXRoX2RldGFp bGVkX2luZm8oc2VsZik6CisgICAgICAgIHNlbGYuX2Fzc2VydF9mYWlsZWRfb25fbGluZSgiIiIK KyAgICAxOiAxMDgwIG1zCis6VGltZSAtPiBbMTA4MCwgMTEyMCwgMTA5NSwgMTEwMSwgMTEwNF0g bXMKKyIiIiwgJ0VSUk9SOiAgICAgMTogMTA4MCBtc1xuJykKKworICAgIGRlZiB0ZXN0X3BhcnNl X291dHB1dF93aXRoX3N0YXRpc3RpY3Moc2VsZik6CisgICAgICAgIHNlbGYuX2Fzc2VydF9mYWls ZWRfb25fbGluZSgiIiIKKzpUaW1lIC0+IFsxMDgwLCAxMTIwLCAxMDk1LCAxMTAxLCAxMTA0XSBt cworICAgIG1lYW46IDEwNSBtcworIiIiLCAnRVJST1I6ICAgICBtZWFuOiAxMDUgbXNcbicpCiAK ICAgICBkZWYgdGVzdF9wYXJzZV9vdXRwdXRfd2l0aF9kZXNjcmlwdGlvbihzZWxmKToKICAgICAg ICAgb3V0cHV0ID0gRHJpdmVyT3V0cHV0KCIiIgogRGVzY3JpcHRpb246IHRoaXMgaXMgYSB0ZXN0 IGRlc2NyaXB0aW9uLgogCi1SdW5uaW5nIDIwIHRpbWVzCi1JZ25vcmluZyB3YXJtLXVwIHJ1biAo MTExNSkKLQotVGltZToKLXZhbHVlcyAxMDgwLCAxMTIwLCAxMDk1LCAxMTAxLCAxMTA0IG1zCi1h dmcgMTEwMCBtcwotbWVkaWFuIDExMDEgbXMKLXN0ZGV2IDE0LjUwODYyIG1zCi1taW4gMTA4MCBt cwotbWF4IDExMjAgbXMiIiIsIGltYWdlPU5vbmUsIGltYWdlX2hhc2g9Tm9uZSwgYXVkaW89Tm9u ZSkKKzpUaW1lIC0+IFsxMDgwLCAxMTIwLCAxMDk1LCAxMTAxLCAxMTA0XSBtcworIiIiLCBpbWFn ZT1Ob25lLCBpbWFnZV9oYXNoPU5vbmUsIGF1ZGlvPU5vbmUpCiAgICAgICAgIHRlc3QgPSBQZXJm VGVzdChNb2NrUG9ydCgpLCAnc29tZS10ZXN0JywgJy9wYXRoL3NvbWUtZGlyL3NvbWUtdGVzdCcp CiAgICAgICAgIHNlbGYuX2Fzc2VydF9yZXN1bHRzX2FyZV9jb3JyZWN0KHRlc3QsIG91dHB1dCkK ICAgICAgICAgc2VsZi5hc3NlcnRFcXVhbCh0ZXN0LmRlc2NyaXB0aW9uKCksICd0aGlzIGlzIGEg dGVzdCBkZXNjcmlwdGlvbi4nKQpAQCAtMTgyLDE4ICsxNzAsMTEgQEAgU2hvdWxkIG5vdCBiZSBp Z25vcmVkCiAKICAgICBkZWYgdGVzdF9wYXJzZV9vdXRwdXRfd2l0aF9zdWJ0ZXN0cyhzZWxmKToK ICAgICAgICAgb3V0cHV0ID0gRHJpdmVyT3V0cHV0KCIiIgotUnVubmluZyAyMCB0aW1lcwotc29t ZSB0ZXN0OiBbMSwgMiwgMywgNCwgNV0KLW90aGVyIHRlc3QgPSBlbHNlOiBbNiwgNywgOCwgOSwg MTBdCi1JZ25vcmluZyB3YXJtLXVwIHJ1biAoMTExNSkKLQotVGltZToKLXZhbHVlcyAxMDgwLCAx MTIwLCAxMDk1LCAxMTAxLCAxMTA0IG1zCi1hdmcgMTEwMCBtcwotbWVkaWFuIDExMDEgbXMKLXN0 ZGV2IDE0LjUwODYyIG1zCi1taW4gMTA4MCBtcwotbWF4IDExMjAgbXMKK0Rlc2NyaXB0aW9uOiB0 aGlzIGlzIGEgdGVzdCBkZXNjcmlwdGlvbi4KK3NvbWUgdGVzdCAtPiBbMSwgMiwgMywgNCwgNV0K K3NvbWUgb3RoZXIgdGVzdCA9IGVsc2UgLT4gWzYsIDcsIDgsIDksIDEwXQorCis6VGltZSAtPiBb MTA4MCwgMTEyMCwgMTA5NSwgMTEwMSwgMTEwNF0gbXMKICIiIiwgaW1hZ2U9Tm9uZSwgaW1hZ2Vf aGFzaD1Ob25lLCBhdWRpbz1Ob25lKQogICAgICAgICBvdXRwdXRfY2FwdHVyZSA9IE91dHB1dENh cHR1cmUoKQogICAgICAgICBvdXRwdXRfY2FwdHVyZS5jYXB0dXJlX291dHB1dCgpCkBAIC0yMTQs MTYgKzE5NSw5IEBAIGNsYXNzIFRlc3RTaW5nbGVQcm9jZXNzUGVyZlRlc3QodW5pdHRlc3QuVGVz dENhc2UpOgogICAgICAgICBkZWYgcnVuX3NpbmdsZShkcml2ZXIsIHBhdGgsIHRpbWVfb3V0X21z KToKICAgICAgICAgICAgIGNhbGxlZFswXSArPSAxCiAgICAgICAgICAgICByZXR1cm4gRHJpdmVy T3V0cHV0KCIiIgotUnVubmluZyAyMCB0aW1lcwotSWdub3Jpbmcgd2FybS11cCBydW4gKDExMTUp Ci0KLVRpbWU6Ci12YWx1ZXMgMTA4MCwgMTEyMCwgMTA5NSwgMTEwMSwgMTEwNCBtcwotYXZnIDEx MDAgbXMKLW1lZGlhbiAxMTAxIG1zCi1zdGRldiAxNC41MDg2MiBtcwotbWluIDEwODAgbXMKLW1h eCAxMTIwIG1zIiIiLCBpbWFnZT1Ob25lLCBpbWFnZV9oYXNoPU5vbmUsIGF1ZGlvPU5vbmUpCitE ZXNjcmlwdGlvbjogdGhpcyBpcyBhIHRlc3QgZGVzY3JpcHRpb24uCis6VGltZSAtPiBbMTA4MCwg MTEyMCwgMTA5NSwgMTEwMSwgMTEwNF0gbXMKKyIiIiwgaW1hZ2U9Tm9uZSwgaW1hZ2VfaGFzaD1O b25lLCBhdWRpbz1Ob25lKQogCiAgICAgICAgIHRlc3QgPSBTaW5nbGVQcm9jZXNzUGVyZlRlc3Qo TW9ja1BvcnQoKSwgJ3NvbWUtdGVzdCcsICcvcGF0aC9zb21lLWRpci9zb21lLXRlc3QnKQogICAg ICAgICB0ZXN0LnJ1bl9zaW5nbGUgPSBydW5fc2luZ2xlCmRpZmYgLS1naXQgYS9Ub29scy9TY3Jp cHRzL3dlYmtpdHB5L3BlcmZvcm1hbmNlX3Rlc3RzL3BlcmZ0ZXN0c3J1bm5lcl9pbnRlZ3JhdGlv bnRlc3QucHkgYi9Ub29scy9TY3JpcHRzL3dlYmtpdHB5L3BlcmZvcm1hbmNlX3Rlc3RzL3BlcmZ0 ZXN0c3J1bm5lcl9pbnRlZ3JhdGlvbnRlc3QucHkKaW5kZXggYTA4MzJhOWNkMTU5NTMxYjE0NDhh NmEzYzBjYWFkNWE5NDY2ZmZjNi4uMGIwNGJmOTNlYWRhZTkwNmEwMGJkZmE0ZGQ1NTg4MmViYzJk NjYzZSAxMDA2NDQKLS0tIGEvVG9vbHMvU2NyaXB0cy93ZWJraXRweS9wZXJmb3JtYW5jZV90ZXN0 cy9wZXJmdGVzdHNydW5uZXJfaW50ZWdyYXRpb250ZXN0LnB5CisrKyBiL1Rvb2xzL1NjcmlwdHMv d2Via2l0cHkvcGVyZm9ybWFuY2VfdGVzdHMvcGVyZnRlc3RzcnVubmVyX2ludGVncmF0aW9udGVz dC5weQpAQCAtNDMsMzYgKzQzLDcgQEAgZnJvbSB3ZWJraXRweS5wZXJmb3JtYW5jZV90ZXN0cy5w ZXJmdGVzdHNydW5uZXIgaW1wb3J0IFBlcmZUZXN0c1J1bm5lcgogCiAKIGNsYXNzIEV2ZW50VGFy Z2V0V3JhcHBlclRlc3REYXRhOgotICAgIHRleHQgPSAiIiJSdW5uaW5nIDIwIHRpbWVzCi1JZ25v cmluZyB3YXJtLXVwIHJ1biAoMTUwMikKLTE1MDQKLTE1MDUKLTE1MTAKLTE1MDQKLTE1MDcKLTE1 MDkKLTE1MTAKLTE0ODcKLTE0ODgKLTE0NzIKLTE0NzIKLTE0ODgKLTE0NzMKLTE0NzIKLTE0NzUK LTE0ODcKLTE0ODYKLTE0ODYKLTE0NzUKLTE0NzEKLQotVGltZToKLXZhbHVlcyAxNDg2LCAxNDcx LCAxNTEwLCAxNTA1LCAxNDc4LCAxNDkwIG1zCi1hdmcgMTQ5MCBtcwotbWVkaWFuIDE0ODggbXMK LXN0ZGV2IDE1LjEzOTM1IG1zCi1taW4gMTQ3MSBtcwotbWF4IDE1MTAgbXMKKyAgICB0ZXh0ID0g IiIiOlRpbWUgLT4gWzE0ODYsIDE0NzEsIDE1MTAsIDE1MDUsIDE0NzgsIDE0OTBdIG1zCiAiIiIK IAogICAgIG91dHB1dCA9ICIiIlJ1bm5pbmcgQmluZGluZ3MvZXZlbnQtdGFyZ2V0LXdyYXBwZXIu aHRtbCAoMSBvZiAyKQpAQCAtODcsMTYgKzU4LDcgQEAgRmluaXNoZWQ6IDAuMSBzCiAKIAogY2xh c3MgU29tZVBhcnNlclRlc3REYXRhOgotICAgIHRleHQgPSAiIiJSdW5uaW5nIDIwIHRpbWVzCi1J Z25vcmluZyB3YXJtLXVwIHJ1biAoMTExNSkKLQotVGltZToKLXZhbHVlcyAxMDgwLCAxMTIwLCAx MDk1LCAxMTAxLCAxMTA0IG1zCi1hdmcgMTEwMCBtcwotbWVkaWFuIDExMDEgbXMKLXN0ZGV2IDE0 LjUwODYxIG1zCi1taW4gMTA4MCBtcwotbWF4IDExMjAgbXMKKyAgICB0ZXh0ID0gIiIiOlRpbWUg LT4gWzEwODAsIDExMjAsIDEwOTUsIDExMDEsIDExMDRdIG1zCiAiIiIKIAogICAgIG91dHB1dCA9 ICIiIlJ1bm5pbmcgUGFyc2VyL3NvbWUtcGFyc2VyLmh0bWwgKDIgb2YgMikKQEAgLTExMSwzMiAr NzMsMTEgQEAgRmluaXNoZWQ6IDAuMSBzCiAKIAogY2xhc3MgTWVtb3J5VGVzdERhdGE6Ci0gICAg dGV4dCA9ICIiIlJ1bm5pbmcgMjAgdGltZXMKLUlnbm9yaW5nIHdhcm0tdXAgcnVuICgxMTE1KQot Ci1UaW1lOgotdmFsdWVzIDEwODAsIDExMjAsIDEwOTUsIDExMDEsIDExMDQgbXMKLWF2ZyAxMTAw IG1zCi1tZWRpYW4gMTEwMSBtcwotc3RkZXYgMTQuNTA4NjEgbXMKLW1pbiAxMDgwIG1zCi1tYXgg MTEyMCBtcwotCi1KUyBIZWFwOgotdmFsdWVzIDgyNTAwMCwgODExMDAwLCA4NDgwMDAsIDgzNzAw MCwgODI5MDAwIGJ5dGVzCi1hdmcgODMwMDAwIGJ5dGVzCi1tZWRpYW4gODI5MDAwIGJ5dGVzCi1z dGRldiAxMzc4NC4wNDg3NSBieXRlcwotbWluIDgxMTAwMCBieXRlcwotbWF4IDg0ODAwMCBieXRl cwotCi1NYWxsb2M6Ci12YWx1ZXMgNTI5MDAwLCA1MTEwMDAsIDU0ODAwMCwgNTM2MDAwLCA1MjEw MDAgYnl0ZXMKLWF2ZyA1MjkwMDAgYnl0ZXMKLW1lZGlhbiA1MjkwMDAgYnl0ZXMKLXN0ZGV2IDE0 MTI0LjQ0Njg5IGJ5dGVzCi1taW4gNTExMDAwIGJ5dGVzCi1tYXggNTQ4MDAwIGJ5dGVzCisgICAg dGV4dCA9ICIiIjpUaW1lIC0+IFsxMDgwLCAxMTIwLCAxMDk1LCAxMTAxLCAxMTA0XSBtcworCis6 SlNIZWFwIC0+IFs4MjUwMDAsIDgxMTAwMCwgODQ4MDAwLCA4MzcwMDAsIDgyOTAwMF0gYnl0ZXMK KworOk1hbGxvYyAtPiBbNTI5MDAwLCA1MTEwMDAsIDU0ODAwMCwgNTM2MDAwLCA1MjEwMDBdIGJ5 dGVzCiAiIiIKIAogICAgIG91dHB1dCA9ICIiIlJ1bm5pbmcgMSB0ZXN0cwpkaWZmIC0tZ2l0IGEv TGF5b3V0VGVzdHMvQ2hhbmdlTG9nIGIvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCmluZGV4IDc4Zjgw N2IzMTUzZjYxNWMwMTdlZDllZjk3MzE4NzQ0ODNhYjhkNTEuLjY2ZjM1ZjZjNzA4OGRjNjUyYzhi OTgzN2RiZGE2YmM3NTA0YjEyMzggMTAwNjQ0Ci0tLSBhL0xheW91dFRlc3RzL0NoYW5nZUxvZwor KysgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKQEAgLTEsMyArMSwxNCBAQAorMjAxMy0xMS0xOCAg Unlvc3VrZSBOaXdhICA8cm5pd2FAd2Via2l0Lm9yZz4KKworICAgICAgICBTaW1wbGlmeSBhbmQg cmVmb3JtYXQgdGhlIG91dHB1dCBvZiBwZXJmb3JtYW5jZSB0ZXN0cyBpbnNpZGUgdGVzdCBydW5u ZXJzCisgICAgICAgIGh0dHBzOi8vYnVncy53ZWJraXQub3JnL3Nob3dfYnVnLmNnaT9pZD0xMjQ0 OTYKKworICAgICAgICBSZXZpZXdlZCBieSBOT0JPRFkgKE9PUFMhKS4KKworICAgICAgICBSZWJh c2VsaW5lIHRoZSBleHBlY3RlZCByZXN1bHQgbm93IHRoYXQgdGhlIG91dHB1dCBoYXMgYmVlbiBz aW1wbGlmaWVkLgorCisgICAgICAgICogZmFzdC9oYXJuZXNzL3BlcmZ0ZXN0cy9ydW5zLXBlci1z ZWNvbmQtbG9nLWV4cGVjdGVkLnR4dDoKKwogMjAxMy0xMS0wNyAgR3l1eW91bmcgS2ltICA8Z3l1 eW91bmcua2ltQHNhbXN1bmcuY29tPgogCiAgICAgICAgIFVucmV2aWV3ZWQsIHJvbGxpbmcgb3V0 IHIxNTg4NDYuCmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9mYXN0L2hhcm5lc3MvcGVyZnRlc3Rz L3J1bnMtcGVyLXNlY29uZC1sb2ctZXhwZWN0ZWQudHh0IGIvTGF5b3V0VGVzdHMvZmFzdC9oYXJu ZXNzL3BlcmZ0ZXN0cy9ydW5zLXBlci1zZWNvbmQtbG9nLWV4cGVjdGVkLnR4dAppbmRleCAwNTI1 N2RmNWQwYmZjMjUzOTQ3MGE3YmNhZmNiYmI1MGRhZWJiY2Q1Li4xYTdlZTYyYjk1ZDZiN2Q4MWJk ZjNmMmFlNzkxODVkNjhjODllZDAwIDEwMDY0NAotLS0gYS9MYXlvdXRUZXN0cy9mYXN0L2hhcm5l c3MvcGVyZnRlc3RzL3J1bnMtcGVyLXNlY29uZC1sb2ctZXhwZWN0ZWQudHh0CisrKyBiL0xheW91 dFRlc3RzL2Zhc3QvaGFybmVzcy9wZXJmdGVzdHMvcnVucy1wZXItc2Vjb25kLWxvZy1leHBlY3Rl ZC50eHQKQEAgLTEsMTggKzEsNSBAQAogVGhpcyB0ZXN0IHZlcmlmaWVzIFBlcmZUZXN0UnVubmVy LnJ1blBlclNlY29uZCgpIG91dHB1dHMgbG9nIGFzIGV4cGVjdGVkLgogCi1SdW5uaW5nIDUgdGlt ZXMKLUlnbm9yaW5nIHdhcm0tdXAgcnVuICgxIHJ1bnMvcykKLTIgcnVucy9zCi00IHJ1bnMvcwot NSBydW5zL3MKLTggcnVucy9zCi0xMCBydW5zL3MKIAotVGltZToKLXZhbHVlcyAyLCA0LCA1LCA4 LCAxMCBydW5zL3MKLWF2ZyA1LjggcnVucy9zCi1tZWRpYW4gNSBydW5zL3MKLXN0ZGV2IDMuMTkg cnVucy9zCi1taW4gMiBydW5zL3MKLW1heCAxMCBydW5zL3MKKzpUaW1lIC0+IFsyLCA0LCA1LCA4 LCAxMF0gcnVucy9zCiAKZGlmZiAtLWdpdCBhL1BlcmZvcm1hbmNlVGVzdHMvQ2hhbmdlTG9nIGIv UGVyZm9ybWFuY2VUZXN0cy9DaGFuZ2VMb2cKaW5kZXggZWYzNmU4Y2QwYzJkOGNkMzA4ODFhZjQ0 ZTcyNDNhYmYwYzYxMTAxOC4uMDRmNTE0NjA5Y2VkY2NlNzY5MmJiMWMxYzgwYzRiOTAwMTRjZGE3 OCAxMDA2NDQKLS0tIGEvUGVyZm9ybWFuY2VUZXN0cy9DaGFuZ2VMb2cKKysrIGIvUGVyZm9ybWFu Y2VUZXN0cy9DaGFuZ2VMb2cKQEAgLTEsMyArMSw1MCBAQAorMjAxMy0xMS0xOCAgUnlvc3VrZSBO aXdhICA8cm5pd2FAd2Via2l0Lm9yZz4KKworICAgICAgICBTaW1wbGlmeSBhbmQgcmVmb3JtYXQg dGhlIG91dHB1dCBvZiBwZXJmb3JtYW5jZSB0ZXN0cyBpbnNpZGUgdGVzdCBydW5uZXJzCisgICAg ICAgIGh0dHBzOi8vYnVncy53ZWJraXQub3JnL3Nob3dfYnVnLmNnaT9pZD0xMjQ0OTYKKworICAg ICAgICBSZXZpZXdlZCBieSBOT0JPRFkgKE9PUFMhKS4KKworICAgICAgICBBcyBhIHByZXBhcmF0 aW9uIHRvIHN1cHBvcnQgc3VidGVzdHMgZm9yIERyb21hZW8gYW5kIERvWW91RXZlbkJlbmNoLCBz aW1wbGlmeSB0aGUgb3V0cHV0IHBlcmZvcm1hbmNlIHRlc3RzIGdlbmVyYXRlLgorICAgICAgICBB bHNvIG1vZGVybml6ZSB0aGUgb3V0cHV0IHRvIGJldHRlciBzdXBwb3J0ICJtZXRyaWMiIGNvbmNl cHQgd2UgaW50cm9kdWNlZCBhIHdoaWxlIGFnby4KKworICAgICAgICBOZXcgb3V0cHV0IG9uIERy b21hZW8vZG9tLWF0dHIgbG9va3MgbGlrZSB0aGlzOgorICAgICAgICAtLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQorICAgICAgICBSdW5uaW5nIDUgdGltZXMK KyAgICAgICAgZ2V0QXR0cmlidXRlIC0+IFsxMTA1LCAxMTA4LCAxMTM0LCAxMTM3LCAxMTU0XQor ICAgICAgICBlbGVtZW50LnByb3BlcnR5IC0+IFsxNjM0LCAxNjU1LCAxNjg1LCAxNjk2LCAxNzIz XQorICAgICAgICBzZXRBdHRyaWJ1dGUgLT4gWzY0Ni4zNTM2NDYzNTM2NDY0LCA2NTEsIDY1MSwg NjU2LjM0MzY1NjM0MzY1NjMsIDY1OF0KKyAgICAgICAgZWxlbWVudC5wcm9wZXJ0eSA9IHZhbHVl IC0+IFs5MzQsIDk0OSwgOTYzLCA5NjQsIDk3NF0KKyAgICAgICAgZWxlbWVudC5leHBhbmRvID0g dmFsdWUgLT4gWzQxOSwgNDE5LjU4MDQxOTU4MDQxOTYsIDQyMS41Nzg0MjE1Nzg0MjE1NywgNDI1 LjU3NDQyNTU3NDQyNTU2LCA0MjldCisgICAgICAgIGVsZW1lbnQuZXhwYW5kbyAtPiBbNTAxLCA1 MTcsIDUxOS40ODA1MTk0ODA1MTk0LCA1MjEuNDc4NTIxNDc4NTIxNCwgNTI1XQorCisgICAgICAg ICAgICAxOiAxMTcuNDA2NDQ3ODU1NzE1ODUgcnVucy9zCisgICAgICAgICAgICAyOiAxMTguODQ3 MjA0Njk2NjYyOTcgcnVucy9zCisgICAgICAgICAgICAzOiAxMTkuODA1NDc2NDA5MDUwMjEgcnVu cy9zCisgICAgICAgICAgICA0OiAxMjAuNTE4ODYxOTQ3NTg4MDUgcnVucy9zCisgICAgICAgICAg ICA1OiAxMjEuNTE5MjQzODA1NjkyOTUgcnVucy9zCisKKyAgICAgICAgOlRpbWUgLT4gWzExNy40 MDY0NDc4NTU3MTU4NSwgMTE4Ljg0NzIwNDY5NjY2Mjk3LCAxMTkuODA1NDc2NDA5MDUwMjEsIDEy MC41MTg4NjE5NDc1ODgwNSwgMTIxLjUxOTI0MzgwNTY5Mjk1XSBydW5zL3MKKyAgICAgICAgICAg IG1lYW46IDExOS42MTk0NDY5NDI5NDIgcnVucy9zCisgICAgICAgICAgICBtZWRpYW46IDExOS44 MDU0NzY0MDkwNTAyMSBydW5zL3MKKyAgICAgICAgICAgIHN0ZGV2OiAxLjU3NjkwNDA0NTg3MzA1 MDYgcnVucy9zCisgICAgICAgICAgICBtaW46IDExNy40MDY0NDc4NTU3MTU4NSBydW5zL3MKKyAg ICAgICAgICAgIG1heDogMTIxLjUxOTI0MzgwNTY5Mjk1IHJ1bnMvcworICAgICAgICAtLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQorCisgICAgICAgICogRHJv bWFlby9yZXNvdXJjZXMvZHJvbWFlb3J1bm5lci5qczoKKyAgICAgICAgKERSVC5wcm9ncmVzcyk6 IFVzZSB0aGUgbmV3IGZvcm1hdCBmb3Igc3VidGVzdCByZXBvcnRzLgorICAgICAgICAqIHJlc291 cmNlcy9ydW5uZXIuanM6CisgICAgICAgICguKTogRGVjbGFyZSB2ZXJib3NlTG9nZ2luZywgd2hp Y2ggaXMgc2V0IHRvIHRydWUgb3V0c2lkZSBvZiB0ZXN0IHJ1bm5lcnMuCisgICAgICAgIChQZXJm VGVzdFJ1bm5lci5sb2dJbmZvKTogVXNlIHZlcmJvc2VMb2dnaW5nIGluc3RlYWQgb2YgZGlyZWN0 bHkgY2hlY2tpbmcgd2luZG93LnRlc3RSdW5uZXIuCisgICAgICAgIChQZXJmVGVzdFJ1bm5lci5s b2dEZXRhaWwpOiBBZGRlZC4gTG9ncyBpbmZvcm1hdGl2ZSB0ZXh0IHdpdGggYSBsYWJlbCBzdWNo IGFzICJtZWFuOiAxMjMgcyIgd2l0aCA0LXNwYWNlIGluZGVudGF0aW9uLgorICAgICAgICAoUGVy ZlRlc3RSdW5uZXIubG9nU3RhdGlzdGljcyk6IFVzZSBsb2dEZXRhaWwuCisgICAgICAgICguc3Rh cnQpOiBJbml0aWFsaXplIHZlcmJvc2VMb2dnaW5nLiBBbHNvIGxvZyAiUnVubmluZyAyMCB0aW1l cyIgYXMgYW4gaW5mb3JtYXRpdmUgbG9nIHVzaW5nIGxvZ0RldGFpbC4KKyAgICAgICAgKC5pZ25v cmVXYXJtVXBBbmRMb2cpOiBVc2UgbG9nRGV0YWlsIGZvciBzaG93aW5nIHRoZSBwcm9ncmVzcy4g VGhlc2UgbG9ncyB3ZXJlIHVzZWxlc3MgaW5zaWRlIHRlc3QgcnVubmVycyBhbnl3YXkKKyAgICAg ICAgYmVjYXVzZSBwZXJmdGVzdCBkaWRuJ3QgZ2V0IHRvIHNlZSBhbnkgb3V0cHV0IHVudGlsIHRo ZSB0ZXN0IGZpbmlzaGVkIHJ1bm5pbmcuCisgICAgICAgICguZmluaXNoKTogQ2FsbCBsb2dTdGF0 aXN0aWNzIHdpdGggbWV0cmljIG5hbWUgYXMgb3Bwb3NlZCB0byBhIGxhYmVsLiBFYWNoIG1ldHJp YyBuYW1lIGlzIG5vdyBwcmVmaXhlZCB3aXRoICc6JyB0byBiZQorICAgICAgICBkaXN0aW5ndWlz aGFibGUgZnJvbSBzdWJ0ZXN0cywgbWFraW5nIHRoZSBuZXcgZm9ybWF0IGZvcndhcmQgY29tcGF0 aWJsZS4KKwogMjAxMy0xMC0yNSAgU2VyZ2lvIFZpbGxhciBTZW5pbiAgPHN2aWxsYXJAaWdhbGlh LmNvbT4KIAogICAgICAgICBVc2UgYSBWZWN0b3IgaW5zdGVhZCBvZiBIYXNoU2V0IHRvIGNvbXB1 dGVkIHRoZSBvcmRlclZhbHVlcyBpbiBSZW5kZXJGbGV4aWJsZUJveApkaWZmIC0tZ2l0IGEvUGVy Zm9ybWFuY2VUZXN0cy9Ecm9tYWVvL3Jlc291cmNlcy9kcm9tYWVvcnVubmVyLmpzIGIvUGVyZm9y bWFuY2VUZXN0cy9Ecm9tYWVvL3Jlc291cmNlcy9kcm9tYWVvcnVubmVyLmpzCmluZGV4IDYxNTQ4 OWY5YjQ5Nzk2NDA5ZmYxMjkyNTQ2ODE3OTkzOTAyOGQ3MTAuLmNiMzA2ZTkwMmI4ZGNlMzVmM2Y5 NjI4YWI4ODljODU0ZWFkZDI2OTQgMTAwNjQ0Ci0tLSBhL1BlcmZvcm1hbmNlVGVzdHMvRHJvbWFl by9yZXNvdXJjZXMvZHJvbWFlb3J1bm5lci5qcworKysgYi9QZXJmb3JtYW5jZVRlc3RzL0Ryb21h ZW8vcmVzb3VyY2VzL2Ryb21hZW9ydW5uZXIuanMKQEAgLTM4LDkgKzM4LDkgQEAKICAgICAgICAg IH0sCiAKICAgICAgICAgIHByb2dyZXNzOiBmdW5jdGlvbihtZXNzYWdlKSB7Ci0gICAgICAgICAg ICAgdmFyIHNjb3JlID0gbWVzc2FnZS5zdGF0dXMuc2NvcmU7Ci0gICAgICAgICAgICAgaWYgKHNj b3JlKQotICAgICAgICAgICAgICAgICBEUlQubG9nKHNjb3JlLm5hbWUgKyAnOiBbJyArIHNjb3Jl LnRpbWVzLmpvaW4oJywgJykgKyAnXScpOworICAgICAgICAgICAgdmFyIHNjb3JlID0gbWVzc2Fn ZS5zdGF0dXMuc2NvcmU7CisgICAgICAgICAgICBpZiAoc2NvcmUpCisgICAgICAgICAgICAgICAg RFJULmxvZyhzY29yZS5uYW1lICsgJyAtPiBbJyArIHNjb3JlLnRpbWVzLmpvaW4oJywgJykgKyAn XScpOwogICAgICAgICAgfSwKIAogICAgICAgICAgdGVhcmRvd246IGZ1bmN0aW9uKGRhdGEpIHsK ZGlmZiAtLWdpdCBhL1BlcmZvcm1hbmNlVGVzdHMvcmVzb3VyY2VzL3J1bm5lci5qcyBiL1BlcmZv cm1hbmNlVGVzdHMvcmVzb3VyY2VzL3J1bm5lci5qcwppbmRleCA1NzZmMWQxM2U4ZDEzZTk1YmVj OWI1YWUwZmVjNGQ1YWY3MDJiNGY4Li4zMzViOWZjNGMyMmY0ZjIxYjI1MTJkMzQ3ZjAxOWE4ZmVm ZWM1YmQyIDEwMDc1NQotLS0gYS9QZXJmb3JtYW5jZVRlc3RzL3Jlc291cmNlcy9ydW5uZXIuanMK KysrIGIvUGVyZm9ybWFuY2VUZXN0cy9yZXNvdXJjZXMvcnVubmVyLmpzCkBAIC03LDYgKzcsNyBA QCBpZiAod2luZG93LnRlc3RSdW5uZXIpIHsKIAogKGZ1bmN0aW9uICgpIHsKICAgICB2YXIgbG9n TGluZXMgPSBudWxsOworICAgIHZhciB2ZXJib3NlTG9nZ2luZyA9IGZhbHNlOwogICAgIHZhciBj b21wbGV0ZWRJdGVyYXRpb25zID0gLTE7CiAgICAgdmFyIGNhbGxzUGVySXRlcmF0aW9uID0gMTsK ICAgICB2YXIgY3VycmVudFRlc3QgPSBudWxsOwpAQCAtNDEsMTAgKzQyLDE1IEBAIGlmICh3aW5k b3cudGVzdFJ1bm5lcikgewogICAgIFBlcmZUZXN0UnVubmVyLm5vdyA9IHdpbmRvdy5wZXJmb3Jt YW5jZSAmJiB3aW5kb3cucGVyZm9ybWFuY2Uubm93ID8gZnVuY3Rpb24gKCkgeyByZXR1cm4gd2lu ZG93LnBlcmZvcm1hbmNlLm5vdygpOyB9IDogRGF0ZS5ub3c7CiAKICAgICBQZXJmVGVzdFJ1bm5l ci5sb2dJbmZvID0gZnVuY3Rpb24gKHRleHQpIHsKLSAgICAgICAgaWYgKCF3aW5kb3cudGVzdFJ1 bm5lcikKKyAgICAgICAgaWYgKHZlcmJvc2VMb2dnaW5nKQogICAgICAgICAgICAgdGhpcy5sb2co dGV4dCk7CiAgICAgfQogCisgICAgUGVyZlRlc3RSdW5uZXIubG9nRGV0YWlsID0gZnVuY3Rpb24g KGxhYmVsLCB2YWx1ZSkgeworICAgICAgICBpZiAodmVyYm9zZUxvZ2dpbmcpCisgICAgICAgICAg ICB0aGlzLmxvZygnICAgICcgKyBsYWJlbCArICc6ICcgKyB2YWx1ZSk7CisgICAgfQorCiAgICAg UGVyZlRlc3RSdW5uZXIubG9hZEZpbGUgPSBmdW5jdGlvbiAocGF0aCkgewogICAgICAgICB2YXIg eGhyID0gbmV3IFhNTEh0dHBSZXF1ZXN0KCk7CiAgICAgICAgIHhoci5vcGVuKCJHRVQiLCBwYXRo LCBmYWxzZSk7CkBAIC04NiwxNCArOTIsMTAgQEAgaWYgKHdpbmRvdy50ZXN0UnVubmVyKSB7CiAg ICAgUGVyZlRlc3RSdW5uZXIubG9nU3RhdGlzdGljcyA9IGZ1bmN0aW9uICh2YWx1ZXMsIHVuaXQs IHRpdGxlKSB7CiAgICAgICAgIHZhciBzdGF0aXN0aWNzID0gdGhpcy5jb21wdXRlU3RhdGlzdGlj cyh2YWx1ZXMsIHVuaXQpOwogICAgICAgICB0aGlzLmxvZygiIik7Ci0gICAgICAgIHRoaXMubG9n KHRpdGxlKTsKLSAgICAgICAgaWYgKHN0YXRpc3RpY3MudmFsdWVzKQotICAgICAgICAgICAgdGhp cy5sb2coInZhbHVlcyAiICsgc3RhdGlzdGljcy52YWx1ZXMuam9pbigiLCAiKSArICIgIiArIHN0 YXRpc3RpY3MudW5pdCk7Ci0gICAgICAgIHRoaXMubG9nKCJhdmcgIiArIHN0YXRpc3RpY3MubWVh biArICIgIiArIHN0YXRpc3RpY3MudW5pdCk7Ci0gICAgICAgIHRoaXMubG9nKCJtZWRpYW4gIiAr IHN0YXRpc3RpY3MubWVkaWFuICsgIiAiICsgc3RhdGlzdGljcy51bml0KTsKLSAgICAgICAgdGhp cy5sb2coInN0ZGV2ICIgKyBzdGF0aXN0aWNzLnN0ZGV2ICsgIiAiICsgc3RhdGlzdGljcy51bml0 KTsKLSAgICAgICAgdGhpcy5sb2coIm1pbiAiICsgc3RhdGlzdGljcy5taW4gKyAiICIgKyBzdGF0 aXN0aWNzLnVuaXQpOwotICAgICAgICB0aGlzLmxvZygibWF4ICIgKyBzdGF0aXN0aWNzLm1heCAr ICIgIiArIHN0YXRpc3RpY3MudW5pdCk7CisgICAgICAgIHRoaXMubG9nKHRpdGxlICsgIiAtPiBb IiArIHN0YXRpc3RpY3MudmFsdWVzLmpvaW4oIiwgIikgKyAiXSAiICsgc3RhdGlzdGljcy51bml0 KTsKKyAgICAgICAgWyJtZWFuIiwgIm1lZGlhbiIsICJzdGRldiIsICJtaW4iLCAibWF4Il0uZm9y RWFjaChmdW5jdGlvbiAobmFtZSkgeworICAgICAgICAgICAgUGVyZlRlc3RSdW5uZXIubG9nRGV0 YWlsKG5hbWUsIHN0YXRpc3RpY3NbbmFtZV0gKyAnICcgKyBzdGF0aXN0aWNzLnVuaXQpOworICAg ICAgICB9KTsKICAgICB9CiAKICAgICBmdW5jdGlvbiBnZXRVc2VkTWFsbG9jSGVhcCgpIHsKQEAg LTE1Myw3ICsxNTUsOCBAQCBpZiAod2luZG93LnRlc3RSdW5uZXIpIHsKICAgICAgICAgLy8gRklY TUU6IERvbid0IGhhcmQgY29kZSB0aGUgbnVtYmVyIG9mIGluLXByb2Nlc3MgaXRlcmF0aW9ucyB0 byB1c2UgaW5zaWRlIGEgdGVzdCBydW5uZXIuCiAgICAgICAgIGl0ZXJhdGlvbkNvdW50ID0gdGVz dC5kcm9tYWVvSXRlcmF0aW9uQ291bnQgfHwgKHdpbmRvdy50ZXN0UnVubmVyID8gNSA6IDIwKTsK ICAgICAgICAgbG9nTGluZXMgPSB3aW5kb3cudGVzdFJ1bm5lciA/IFtdIDogbnVsbDsKLSAgICAg ICAgUGVyZlRlc3RSdW5uZXIubG9nKCJSdW5uaW5nICIgKyBpdGVyYXRpb25Db3VudCArICIgdGlt ZXMiKTsKKyAgICAgICAgdmVyYm9zZUxvZ2dpbmcgPSAhd2luZG93LnRlc3RSdW5uZXI7CisgICAg ICAgIFBlcmZUZXN0UnVubmVyLmxvZ0luZm8oIlJ1bm5pbmcgIiArIGl0ZXJhdGlvbkNvdW50ICsg IiB0aW1lcyIpOwogICAgICAgICBpZiAodGVzdC5kb05vdElnbm9yZUluaXRpYWxSdW4pCiAgICAg ICAgICAgICBjb21wbGV0ZWRJdGVyYXRpb25zKys7CiAgICAgICAgIGlmIChydW5uZXIpCkBAIC0x OTIsMTQgKzE5NSwxNCBAQCBpZiAod2luZG93LnRlc3RSdW5uZXIpIHsKICAgICBmdW5jdGlvbiBp Z25vcmVXYXJtVXBBbmRMb2cobWVhc3VyZWRWYWx1ZSkgewogICAgICAgICB2YXIgbGFiZWxlZFJl c3VsdCA9IG1lYXN1cmVkVmFsdWUgKyAiICIgKyBQZXJmVGVzdFJ1bm5lci51bml0OwogICAgICAg ICBpZiAoY29tcGxldGVkSXRlcmF0aW9ucyA8PSAwKQotICAgICAgICAgICAgUGVyZlRlc3RSdW5u ZXIubG9nKCJJZ25vcmluZyB3YXJtLXVwIHJ1biAoIiArIGxhYmVsZWRSZXN1bHQgKyAiKSIpOwor ICAgICAgICAgICAgUGVyZlRlc3RSdW5uZXIubG9nRGV0YWlsKGNvbXBsZXRlZEl0ZXJhdGlvbnMs IGxhYmVsZWRSZXN1bHQgKyAiIChJZ25vcmVkIHdhcm0tdXAgcnVuKSIpOwogICAgICAgICBlbHNl IHsKICAgICAgICAgICAgIHJlc3VsdHMucHVzaChtZWFzdXJlZFZhbHVlKTsKICAgICAgICAgICAg IGlmICh3aW5kb3cuaW50ZXJuYWxzICYmICFjdXJyZW50VGVzdC5kb05vdE1lYXN1cmVNZW1vcnlV c2FnZSkgewogICAgICAgICAgICAgICAgIGpzSGVhcFJlc3VsdHMucHVzaChnZXRVc2VkSlNIZWFw KCkpOwogICAgICAgICAgICAgICAgIG1hbGxvY0hlYXBSZXN1bHRzLnB1c2goZ2V0VXNlZE1hbGxv Y0hlYXAoKSk7CiAgICAgICAgICAgICB9Ci0gICAgICAgICAgICBQZXJmVGVzdFJ1bm5lci5sb2co bGFiZWxlZFJlc3VsdCk7CisgICAgICAgICAgICBQZXJmVGVzdFJ1bm5lci5sb2dEZXRhaWwoY29t cGxldGVkSXRlcmF0aW9ucywgbGFiZWxlZFJlc3VsdCk7CiAgICAgICAgIH0KICAgICB9CiAKQEAg LTIwNywxMCArMjEwLDEwIEBAIGlmICh3aW5kb3cudGVzdFJ1bm5lcikgewogICAgICAgICB0cnkg ewogICAgICAgICAgICAgaWYgKGN1cnJlbnRUZXN0LmRlc2NyaXB0aW9uKQogICAgICAgICAgICAg ICAgIFBlcmZUZXN0UnVubmVyLmxvZygiRGVzY3JpcHRpb246ICIgKyBjdXJyZW50VGVzdC5kZXNj cmlwdGlvbik7Ci0gICAgICAgICAgICBQZXJmVGVzdFJ1bm5lci5sb2dTdGF0aXN0aWNzKHJlc3Vs dHMsIFBlcmZUZXN0UnVubmVyLnVuaXQsICJUaW1lOiIpOworICAgICAgICAgICAgUGVyZlRlc3RS dW5uZXIubG9nU3RhdGlzdGljcyhyZXN1bHRzLCBQZXJmVGVzdFJ1bm5lci51bml0LCAiOlRpbWUi KTsKICAgICAgICAgICAgIGlmIChqc0hlYXBSZXN1bHRzLmxlbmd0aCkgewotICAgICAgICAgICAg ICAgIFBlcmZUZXN0UnVubmVyLmxvZ1N0YXRpc3RpY3MoanNIZWFwUmVzdWx0cywgImJ5dGVzIiwg IkpTIEhlYXA6Iik7Ci0gICAgICAgICAgICAgICAgUGVyZlRlc3RSdW5uZXIubG9nU3RhdGlzdGlj cyhtYWxsb2NIZWFwUmVzdWx0cywgImJ5dGVzIiwgIk1hbGxvYzoiKTsKKyAgICAgICAgICAgICAg ICBQZXJmVGVzdFJ1bm5lci5sb2dTdGF0aXN0aWNzKGpzSGVhcFJlc3VsdHMsICJieXRlcyIsICI6 SlNIZWFwIik7CisgICAgICAgICAgICAgICAgUGVyZlRlc3RSdW5uZXIubG9nU3RhdGlzdGljcyht YWxsb2NIZWFwUmVzdWx0cywgImJ5dGVzIiwgIjpNYWxsb2MiKTsKICAgICAgICAgICAgIH0KICAg ICAgICAgICAgIGlmIChsb2dMaW5lcykKICAgICAgICAgICAgICAgICBsb2dMaW5lcy5mb3JFYWNo KGxvZ0luRG9jdW1lbnQpOwo=