219116 2020-11-18 14:51:05 -0800 'run-analysis' script should schedule retries for A/B tests even after analysis chart failure. 2020-11-20 17:27:51 -0800 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED P2 Normal --- 1 dewei_zhu dewei_zhu dewei_zhu rniwa oldest_to_newest 1708792 0 dewei_zhu 2020-11-18 14:51:05 -0800 'run-analysis' script should schedule retries for A/B tests even after analysis failure. 1708796 1 414488 dewei_zhu 2020-11-18 14:57:31 -0800 Created attachment 414488 Patch 1708920 2 414488 rniwa 2020-11-18 17:54:10 -0800 Comment on attachment 414488 Patch View in context: https://bugs.webkit.org/attachment.cgi?id=414488&action=review > Websites/perf.webkit.org/tools/run-analysis.js:50 > + console.error(`Failed analyze measurement sets due to ${error}`); Failed *to* analyze > Websites/perf.webkit.org/tools/run-analysis.js:66 > + console.error(`Failed retry for test group due to ${error}`); Failed *to retry test groups* due to 1709713 3 dewei_zhu 2020-11-20 17:27:51 -0800 Change is landed in r270140. 414488 2020-11-18 14:57:31 -0800 2020-11-18 17:54:10 -0800 Patch bug-219116-20201118145730.patch text/plain 3806 dewei_zhu U3VidmVyc2lvbiBSZXZpc2lvbjogMjY5OTkwCmRpZmYgLS1naXQgYS9XZWJzaXRlcy9wZXJmLndl YmtpdC5vcmcvQ2hhbmdlTG9nIGIvV2Vic2l0ZXMvcGVyZi53ZWJraXQub3JnL0NoYW5nZUxvZwpp bmRleCA5Y2ZiOTA1ZjgwNzU5MDQ4NjYzY2UyMDdmOWUwOTEwNDcwMzg5M2M2Li4zZTg3N2JjNjc1 YWIxN2VlMTRiODFkZjRkZGJlYjA1Y2Q0MTdhN2U0IDEwMDY0NAotLS0gYS9XZWJzaXRlcy9wZXJm LndlYmtpdC5vcmcvQ2hhbmdlTG9nCisrKyBiL1dlYnNpdGVzL3BlcmYud2Via2l0Lm9yZy9DaGFu Z2VMb2cKQEAgLTEsMyArMSwxNyBAQAorMjAyMC0xMS0xOCAgRGV3ZWkgWmh1ICA8ZGV3ZWlfemh1 QGFwcGxlLmNvbT4KKworICAgICAgICAncnVuLWFuYWx5c2lzJyBzY3JpcHQgc2hvdWxkIHNjaGVk dWxlIHJldHJpZXMgZm9yIEEvQiB0ZXN0cyBldmVuIGFmdGVyIGNoYXJ0IGFuYWx5c2lzIGZhaWx1 cmUuCisgICAgICAgIGh0dHBzOi8vYnVncy53ZWJraXQub3JnL3Nob3dfYnVnLmNnaT9pZD0yMTkx MTYKKworICAgICAgICBSZXZpZXdlZCBieSBOT0JPRFkgKE9PUFMhKS4KKworICAgICAgICBBbmx5 emluZyBjaGFydHMgYW5kIHNjaGVkdWxlIHJldHJpZXMgZm9yIEEvQiB0ZXN0cyBvbiBydW4tYW5h bHlzaXMgc2NyaXB0IGFyZSBpbmRlcGVuZGVudCB0YXNrLgorICAgICAgICBJdCBzaG91bGQgbm90 IHNraXAgc2NoZWR1bGluZyByZXRyaWVzIGV2ZW4gd2hlbiBjaGFydCBhbmFseXNpcyBwYXJ0IGZh aWxzLgorCisgICAgICAgICogdG9vbHMvcnVuLWFuYWx5c2lzLmpzOgorICAgICAgICAoYXN5bmMg YW5hbHlzaXNMb29wKTogQ2hhbmdlIHRoZSBsb2dpYyBzbyB0aGF0IGNoYXJ0IGFuYWx5c2lzIGZh aWx1cmUgd2lsbCBub3Qgc3RvcCBzY2hlZHVsaW5nIHJldHJpZXMuCisgICAgICAgIEZpeCBhIHR5 cG8gZm9yICdub3RpZmljYXRpb25SZW1vdGVBUEknLgorCiAyMDIwLTExLTE2ICBEZXdlaSBaaHUg IDxkZXdlaV96aHVAYXBwbGUuY29tPgogCiAgICAgICAgIEJ1aWxkYm90VHJpZ2dlcmFibGUgc2hv dWxkIG5vdCBwcm9jZXNzIGEgY29tcGxldGVkIGJ1aWxkIHJlcXVlc3QgZnJvbSBhIGNvbXBsZXRl ZCB0ZXN0IGdyb3VwLgpkaWZmIC0tZ2l0IGEvV2Vic2l0ZXMvcGVyZi53ZWJraXQub3JnL3Rvb2xz L3J1bi1hbmFseXNpcy5qcyBiL1dlYnNpdGVzL3BlcmYud2Via2l0Lm9yZy90b29scy9ydW4tYW5h bHlzaXMuanMKaW5kZXggODViNWUyYTVhZjNlYzMzZTRkN2VmOWU2M2JiYTgxNzA3M2E0YWVkZi4u MDEzMWRhMDc3OTQzYjExMGRlYTVmMjYyMWI0OWQ1MGQ1N2FmOGU3ZSAxMDA2NDQKLS0tIGEvV2Vi c2l0ZXMvcGVyZi53ZWJraXQub3JnL3Rvb2xzL3J1bi1hbmFseXNpcy5qcworKysgYi9XZWJzaXRl cy9wZXJmLndlYmtpdC5vcmcvdG9vbHMvcnVuLWFuYWx5c2lzLmpzCkBAIC0zMyw3ICszMyw2IEBA IGFzeW5jIGZ1bmN0aW9uIGFuYWx5c2lzTG9vcChvcHRpb25zKQogICAgICAgICBjb25zdCBzZXJ2 ZXJDb25maWcgPSBKU09OLnBhcnNlKGZzLnJlYWRGaWxlU3luYyhvcHRpb25zWyctLXNlcnZlci1j b25maWctanNvbiddLCAndXRmLTgnKSk7CiAgICAgICAgIGNvbnN0IG5vdGlmaWNhdGlvbkNvbmZp ZyA9IEpTT04ucGFyc2UoZnMucmVhZEZpbGVTeW5jKG9wdGlvbnNbJy0tbm90aWZpY2F0aW9uLWNv bmZpZy1qc29uJ10sICd1dGYtOCcpKTsKICAgICAgICAgY29uc3QgYW5hbHlzaXNSYW5nZUluRGF5 cyA9IG9wdGlvbnNbJy0tYW5hbHlzaXMtcmFuZ2UtaW4tZGF5cyddOwotICAgICAgICBjb25zdCBt YXhpbXVtUmV0cnlGYWN0b3IgPSBvcHRpb25zWyctLW1heC1yZXRyeS1mYWN0b3InXTsKICAgICAg ICAgc2Vjb25kc1RvU2xlZXAgPSBvcHRpb25zWyctLXNlY29uZHMtdG8tc2xlZXAnXTsKICAgICAg ICAgZ2xvYmFsLlJlbW90ZUFQSSA9IG5ldyBSZW1vdGVBUEkoc2VydmVyQ29uZmlnLnNlcnZlcik7 CiAgICAgICAgIFByaXZpbGVnZWRBUEkuY29uZmlndXJlKHNlcnZlckNvbmZpZy5zbGF2ZS5uYW1l LCBzZXJ2ZXJDb25maWcuc2xhdmUucGFzc3dvcmQpOwpAQCAtNDcsMTkgKzQ2LDI0IEBAIGFzeW5j IGZ1bmN0aW9uIGFuYWx5c2lzTG9vcChvcHRpb25zKQogCiAgICAgICAgIGNvbnNvbGUubG9nKGBT dGFydCBhbmFseXppbmcgbGFzdCAke2FuYWx5c2lzUmFuZ2VJbkRheXN9IGRheXMgbWVhc3VyZW1l bnQgc2V0cy5gKTsKICAgICAgICAgYXdhaXQgYW5hbHl6ZXIuYW5hbHl6ZU9uY2UoKTsKKyAgICB9 IGNhdGNoIChlcnJvcikgeworICAgICAgICBjb25zb2xlLmVycm9yKGBGYWlsZWQgYW5hbHl6ZSBt ZWFzdXJlbWVudCBzZXRzIGR1ZSB0byAke2Vycm9yfWApOworICAgIH0KIAorICAgIHRyeSB7Cisg ICAgICAgIGNvbnN0IG1heGltdW1SZXRyeUZhY3RvciA9IG9wdGlvbnNbJy0tbWF4LXJldHJ5LWZh Y3RvciddOwogICAgICAgICBjb25zdCB0ZXN0R3JvdXBzTWF5TmVlZE1vcmVSZXF1ZXN0cyA9IGF3 YWl0IFRlc3RHcm91cC5mZXRjaEFsbFRoYXRNYXlOZWVkTW9yZVJlcXVlc3RzKCk7CiAgICAgICAg IGF3YWl0IGNyZWF0ZUFkZGl0aW9uYWxCdWlsZFJlcXVlc3RzRm9yVGVzdEdyb3Vwc1dpdGhGYWls ZWRSZXF1ZXN0cyh0ZXN0R3JvdXBzTWF5TmVlZE1vcmVSZXF1ZXN0cywgbWF4aW11bVJldHJ5RmFj dG9yKTsKIAogICAgICAgICBjb25zdCB0ZXN0R3JvdXBzTmVlZE5vdGlmaWNhdGlvbiA9IGF3YWl0 IFRlc3RHcm91cC5mZXRjaEFsbFdpdGhOb3RpZmljYXRpb25SZWFkeSgpOwotICAgICAgICBjb25z dCBub3RpZmljYXRpb25SZW1vdmVBUEkgPSBuZXcgUmVtb3RlQVBJKG5vdGlmaWNhdGlvbkNvbmZp Zy5ub3RpZmljYXRpb25TZXJ2ZXJDb25maWcpOworICAgICAgICBjb25zdCBub3RpZmljYXRpb25S ZW1vdGVBUEkgPSBuZXcgUmVtb3RlQVBJKG5vdGlmaWNhdGlvbkNvbmZpZy5ub3RpZmljYXRpb25T ZXJ2ZXJDb25maWcpOwogICAgICAgICBjb25zdCBub3RpZmljYXRpb25NZXNzYWdlQ29uZmlnID0g bm90aWZpY2F0aW9uQ29uZmlnLm5vdGlmaWNhdGlvbk1lc3NhZ2VDb25maWc7CiAgICAgICAgIGNv bnN0IG5vdGlmaWVyID0gbmV3IEFuYWx5c2lzUmVzdWx0c05vdGlmaWVyKG5vdGlmaWNhdGlvbk1l c3NhZ2VDb25maWcubWVzc2FnZVRlbXBsYXRlLCBub3RpZmljYXRpb25NZXNzYWdlQ29uZmlnLmZp bmFsaXplU2NyaXB0LAotICAgICAgICAgICAgbm90aWZpY2F0aW9uTWVzc2FnZUNvbmZpZy5tZXNz YWdlQ29uc3RydWN0aW9uUnVsZXMsIG5vdGlmaWNhdGlvblJlbW92ZUFQSSwgbm90aWZpY2F0aW9u Q29uZmlnLm5vdGlmaWNhdGlvblNlcnZlckNvbmZpZy5wYXRoLCBuZXcgU3VicHJvY2Vzcyk7Cisg ICAgICAgICAgICBub3RpZmljYXRpb25NZXNzYWdlQ29uZmlnLm1lc3NhZ2VDb25zdHJ1Y3Rpb25S dWxlcywgbm90aWZpY2F0aW9uUmVtb3RlQVBJLCBub3RpZmljYXRpb25Db25maWcubm90aWZpY2F0 aW9uU2VydmVyQ29uZmlnLnBhdGgsIG5ldyBTdWJwcm9jZXNzKTsKIAogICAgICAgICBhd2FpdCBu b3RpZmllci5zZW5kTm90aWZpY2F0aW9uc0ZvclRlc3RHcm91cHModGVzdEdyb3Vwc05lZWROb3Rp ZmljYXRpb24pOwotICAgIH0gY2F0Y2goZXJyb3IpIHsKLSAgICAgICAgY29uc29sZS5lcnJvcihg RmFpbGVkIGFuYWx5emUgbWVhc3VyZW1lbnQgc2V0cyBkdWUgdG8gJHtlcnJvcn1gKTsKKyAgICB9 IGNhdGNoIChlcnJvcikgeworICAgICAgICBjb25zb2xlLmVycm9yKGBGYWlsZWQgcmV0cnkgZm9y IHRlc3QgZ3JvdXAgZHVlIHRvICR7ZXJyb3J9YCk7CiAgICAgfQogCiAgICAgY29uc29sZS5sb2co YFNsZWVwaW5nIGZvciAke3NlY29uZHNUb1NsZWVwfSBzZWNvbmRzLmApOwo=