83411 2012-04-06 16:29:38 -0700 All Mac bots occasionally fail tons of media/ sputnik/ and svg/ tests 2012-09-07 11:02:16 -0700 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) Mac Unspecified REOPENED InRadar, LayoutTestFailure, MakingBotsRed, Regression P2 Normal --- 1 bdakin webkit-unassigned bdakin dpranke eric.carlson feature-media-reviews rniwa simon.fraser thorton tonikitoo webkit-bug-importer webkit.review.bot oldest_to_newest 597802 0 bdakin 2012-04-06 16:29:38 -0700 Starting around the middle of the day on April 5th, the Mac bots started occasionally failing tons of tests, primarily in media/ sputnik/ and svg/. There will be a number of good runs with the expected number of failures right now (0-10 on Lion bots), and then one or two runs with 500+ failures. 597804 1 webkit-bug-importer 2012-04-06 16:30:14 -0700 <rdar://problem/11204404> 597816 2 bdakin 2012-04-06 16:51:25 -0700 It seems like generated results are being compared to the wrong expected results. Somehow, we're getting out of kilter. 597872 3 dpranke 2012-04-06 18:10:36 -0700 Are there example logs for this I can look at? ... Chromium DRT will actually echo the URL for the test back into the output, so there's code in new-run-webkit-tests that actually asserts if the output is for the wrong test. It doesn't look like there's anything equivalent for the non-Chromium ports, so debugging this might be harder than I would like :(. 598477 4 bdakin 2012-04-09 11:49:54 -0700 Has anything changed in the test harness in the last week that could lead to this problem? This is a really terrible issue, and I agree it's hard to debug, so maybe we can just figure out what caused it to start happening. I don't know how long these links will be good for, but here's an example: This test is failing: http://trac.webkit.org/export/113594/trunk/LayoutTests/media/unsupported-rtsp.html Here's the pretty diff: http://build.webkit.org/results/Lion%20Release%20(Tests)/r113594%20(7423)/media/unsupported-rtsp-pretty-diff.html The pretty diff is comparing the results of this test: http://trac.webkit.org/export/113594/trunk/LayoutTests/media/svg-as-image-with-media-blocked.html with the expected results of media/unsupported-rtsp.html, and it only thinks that media/unsupported-rtsp.html is failing because the generated results are from media/svg-as-image-with-media-blocked.html 598481 5 simon.fraser 2012-04-09 11:53:04 -0700 On the Lion Release Tests bot, this started between 113371 and 113376. <http://build.webkit.org/builders/Lion%20Release%20%28Tests%29?numbuilds=200> On Snow Leopard Release Tests, this started between 113363 and 113371. <http://build.webkit.org/builders/SnowLeopard%20Intel%20Release%20%28Tests%29?numbuilds=200> 598790 6 dpranke 2012-04-09 17:31:12 -0700 The only thing that's changed in the harness in that timeframe that looks even remotely related is the change to run *fewer* workers on the bots: https://bugs.webkit.org/show_bug.cgi?id=83076 It's hard to imagine that that would be a problem, though. I haven't gotten to take much of a look at this yet, will keep investigating. 598802 7 simon.fraser 2012-04-09 17:41:28 -0700 My guess is that there's one test that behaves badly (a media test?), and causes the off-by-one for all the other tests run in the same shard. 598853 8 dpranke 2012-04-09 18:41:41 -0700 (In reply to comment #7) > My guess is that there's one test that behaves badly (a media test?), and causes the off-by-one for all the other tests run in the same shard. I think Simon's hypothesis is a good one. I spot-checked a few logs (from builds 7423, 7428, and 7437 on the Lion Release bot) and they all appear to have one worker that starts failing every test starting with media/nodesFromRect-shadowContent.html, so it might be that test. If you then look at the results for 7437, http://build.webkit.org/results/Lion%20Release%20(Tests)/r113622%20(7437)/results.html , you can see that the -actual output for nodesFromRect-shadowContent is repeated in the next failing test, media/remove-from-document-before-load.html . And, interestingly, the -expected for that test says "PASS: A crash did not occur when the media element was removed before loading.". So, I'm guessing that that test is actually crashing, and we're not noticing it, and somehow the internal output buffers in NRWT aren't getting emptied, so we end up reusing the same output twice and everything goes to hell after that. Note that that is the test that is being moved in r113371, so I think we have a pretty good suspect :). Maybe try skipping that test and see if the problem goes away? There's almost certainly also a bug in NRWT that maybe I introduced a few weeks ago when I was reworking the crash log code, so I can start looking for that now that I have a theory, as well. 598885 9 bdakin 2012-04-09 19:09:00 -0700 Thanks for the analysis, Dirk! I will try skipping that test, and we'll see how it goes. 598893 10 bdakin 2012-04-09 19:14:11 -0700 Skipped with http://trac.webkit.org/changeset/113661 598945 11 tonikitoo 2012-04-09 20:17:59 -0700 I would live to see a backtrace of this crash, if it is confirmed. 599554 12 tonikitoo 2012-04-10 13:03:30 -0700 I wonder if the above patch fixes things. We would have to unskip the test again and wait for a few bot cycles. Anyways, the changes below work fine on Gtk and Qt builds, and should go it regardless I would say. diff --git a/LayoutTests/media/nodesFromRect-shadowContent.html b/LayoutTests/media/nodesFromRect-shadowContent.html index d55610a..9fdaf7f 100644 --- a/LayoutTests/media/nodesFromRect-shadowContent.html +++ b/LayoutTests/media/nodesFromRect-shadowContent.html @@ -13,11 +13,6 @@ <script type="text/javascript" charset="utf-8"> function runTest() { - if (window.layoutTestController) { - layoutTestController.dumpAsText(); - layoutTestController.waitUntilDone(); - } - var e = {}; // Set up shortcut access to elements @@ -42,12 +37,7 @@ var shadow =['-webkit-media-controls-timeline-container', '-webkit-media-controls-play-button', '-webkit-media-controls-panel', '-webkit-media-controls']; checkShadowContent(clickX, clickY, 10, 10, 20, 20, shadow); - - if (window.layoutTestController) - layoutTestController.notifyDone(); } - - window.onload = runTest; </script> </head> <body id="body"> @@ -58,6 +48,7 @@ testExpected("video.controls", null, '!='); waitForEvent('canplaythrough', function () { runTest(); + endTest(); } ); video.src = findMediaFile("video", "content/test"); </script> diff --git a/LayoutTests/platform/gtk/media/nodesFromRect-shadowContent-expected.txt b/LayoutTests/platform/gtk/media/nodesFromRect-shadowContent-expected.txt index 390e73e..371f393 100644 --- a/LayoutTests/platform/gtk/media/nodesFromRect-shadowContent-expected.txt +++ b/LayoutTests/platform/gtk/media/nodesFromRect-shadowContent-expected.txt @@ -4,4 +4,5 @@ This test only runs in DRT! EXPECTED (video.controls != 'null') OK EVENT(canplaythrough) +END OF TEST 600502 13 136726 tonikitoo 2012-04-11 12:43:44 -0700 Created attachment 136726 (committed r113910, r=eric_carlson) speculative patch After moving the test to this new location, I accidentally left behind an unneeded line: "window.onload = runTest;". It is unneeded since now the test gets triggered by "waitForEvent('canplaythrough'" Also, remove unneeded LTC calls, since they are called by the helper scripts imported (e.g. video-test.js). Lets see if the Mac bots like this more... 600523 14 simon.fraser 2012-04-11 13:01:09 -0700 As well as fixing the test, we should fix the harness to ensure that bad tests can't trip it up. 600567 15 eric.carlson 2012-04-11 13:47:46 -0700 Please file another bug about the problem with the test harness if one doesn't already exist. 600569 16 simon.fraser 2012-04-11 13:49:30 -0700 This was that bug :( 600571 17 tonikitoo 2012-04-11 13:51:21 -0700 (In reply to comment #16) > This was that bug :( Right. Want me to hold on committing the test fix? 600586 18 dpranke 2012-04-11 14:11:46 -0700 (In reply to comment #14) > As well as fixing the test, we should fix the harness to ensure that bad tests can't trip it up. I will note that fixing things completely probably includes something like the #URL comment that chromium does ... also, we don't actually know for sure that there's a bug in NRWT at the moment; it could be a bug in DRT. But that's quibbling ... 600590 19 tonikitoo 2012-04-11 14:20:35 -0700 Ok, will push and leave the bug opened. Possible useful chat: <eric_carlson> tonikitoo: the changes look OK, but do you know what was causing so many test failures <eric_carlson> tonikitoo: calling notifyDone() twice? <tonikitoo> eric_carlson, maybe that, and also calling runTests twice? <tonikitoo> from window.onload= runtest and waitTillRead(runTest, ...) <eric_carlson> tonikitoo: oh, I maybe having a test continue to generate output after it claimed to have finished... <tonikitoo> that is my guess 600675 20 dpranke 2012-04-11 16:09:10 -0700 (In reply to comment #19) > Ok, will push and leave the bug opened. > > Possible useful chat: > > <eric_carlson> tonikitoo: the changes look OK, but do you know what was causing so many test failures > <eric_carlson> tonikitoo: calling notifyDone() twice? > <tonikitoo> eric_carlson, maybe that, and also calling runTests twice? > <tonikitoo> from window.onload= runtest and waitTillRead(runTest, ...) > <eric_carlson> tonikitoo: oh, I maybe having a test continue to generate output after it claimed to have finished... > <tonikitoo> that is my guess Wait, does this mean that calling runTest() from inside a test can make DRT generate two copies of the output? That seems bad. 600863 21 tonikitoo 2012-04-11 21:28:33 -0700 seems like the patch is still failing on Mac Lion. Investigating... 600872 22 tonikitoo 2012-04-11 21:48:39 -0700 (In reply to comment #21) > seems like the patch is still failing on Mac Lion. Investigating... It seems to need rebaseline: --- /Volumes/Data/slave/lion-intel-release-tests/build/layout-test-results/media/nodesFromRect-shadowContent-expected.txt +++ /Volumes/Data/slave/lion-intel-release-tests/build/layout-test-results/media/nodesFromRect-shadowContent-actual.txt @@ -3,4 +3,6 @@ This test only runs in DRT! EXPECTED (video.controls != 'null') OK +EVENT(canplaythrough) +END OF TEST http://build.webkit.org/results/Lion%20Release%20%28Tests%29/r113910%20%287504%29/media/nodesFromRect-shadowContent-diff.txt 600891 23 136826 tonikitoo 2012-04-11 22:29:26 -0700 Created attachment 136826 rebaseline 600910 24 136826 webkit.review.bot 2012-04-11 23:05:45 -0700 Comment on attachment 136826 rebaseline Clearing flags on attachment: 136826 Committed r113944: <http://trac.webkit.org/changeset/113944> 600911 25 webkit.review.bot 2012-04-11 23:05:52 -0700 All reviewed patches have been landed. Closing bug. 601130 26 tonikitoo 2012-04-12 05:39:02 -0700 . 713970 27 thorton 2012-09-06 18:32:14 -0700 Has anyone seen this recently? Should this bug be closed? 714747 28 simon.fraser 2012-09-07 11:02:16 -0700 I think we're keeping this open to fix: "As well as fixing the test, we should fix the harness to ensure that bad tests can't trip it up." 136726 2012-04-11 12:43:44 -0700 2012-04-11 14:28:33 -0700 (committed r113910, r=eric_carlson) speculative patch 0001-All-Mac-bots-occasionally-fail-tons-of-media-sputnik.patch text/plain 3873 tonikitoo RnJvbSBlNDExMDQ0OGZjZDlhOTVlOWIyYWRkYzg5ODc0NmYwYTdjODRkMDgwIE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiBBbnRvbmlvIEdvbWVzIDxhZ29tZXNAcmltLmNvbT4KRGF0ZTog VHVlLCAxMCBBcHIgMjAxMiAxNjowNToyOCAtMDQwMApTdWJqZWN0OiBbUEFUQ0hdIEFsbCBNYWMg Ym90cyBvY2Nhc2lvbmFsbHkgZmFpbCB0b25zIG9mIG1lZGlhLyBzcHV0bmlrLyBhbmQKIHN2Zy8g dGVzdHMgaHR0cHM6Ly9idWdzLndlYmtpdC5vcmcvc2hvd19idWcuY2dpP2lkPTgzNDExCgpSZXZp ZXdlZCBieSBOT0JPRFkgKE9PUFMhKS4KUGF0Y2ggYnkgQW50b25pbyBHb21lcyA8YWdvbWVzQHJp bS5jb20+CgpGaXggb2J2aW91cyBwcm9ibGVtcyB3aXRoIHRoZSB0ZXN0IGluIG9yZGVyIHRvIG1h a2UgdGVzdHMgbGV0cwpmbGFreS4KCiogbWVkaWEvbm9kZXNGcm9tUmVjdC1zaGFkb3dDb250ZW50 Lmh0bWw6CiogcGxhdGZvcm0vZ3RrL21lZGlhL25vZGVzRnJvbVJlY3Qtc2hhZG93Q29udGVudC1l eHBlY3RlZC50eHQ6Ci0tLQogTGF5b3V0VGVzdHMvQ2hhbmdlTG9nICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgfCAgIDEyICsrKysrKysrKysrKwogTGF5b3V0VGVzdHMvbWVkaWEvbm9kZXNG cm9tUmVjdC1zaGFkb3dDb250ZW50Lmh0bWwgfCAgIDExICstLS0tLS0tLS0tCiAuLi4vbWVkaWEv bm9kZXNGcm9tUmVjdC1zaGFkb3dDb250ZW50LWV4cGVjdGVkLnR4dCB8ICAgIDEgKwogTGF5b3V0 VGVzdHMvcGxhdGZvcm0vbWFjL1NraXBwZWQgICAgICAgICAgICAgICAgICAgfCAgICAzIC0tLQog NCBmaWxlcyBjaGFuZ2VkLCAxNCBpbnNlcnRpb25zKCspLCAxMyBkZWxldGlvbnMoLSkKCmRpZmYg LS1naXQgYS9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5k ZXggNTYzMmIzZi4uNzcxNmE2MyAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisr KyBiL0xheW91dFRlc3RzL0NoYW5nZUxvZwpAQCAtMSwzICsxLDE1IEBACisyMDEyLTA0LTEwICBB bnRvbmlvIEdvbWVzICA8YWdvbWVzQHJpbS5jb20+CisKKyAgICAgICAgQWxsIE1hYyBib3RzIG9j Y2FzaW9uYWxseSBmYWlsIHRvbnMgb2YgbWVkaWEvIHNwdXRuaWsvIGFuZCBzdmcvIHRlc3RzCisg ICAgICAgIGh0dHBzOi8vYnVncy53ZWJraXQub3JnL3Nob3dfYnVnLmNnaT9pZD04MzQxMQorCisg ICAgICAgIFJldmlld2VkIGJ5IE5PQk9EWSAoT09QUyEpLgorCisgICAgICAgIEZpeCBvYnZpb3Vz IHByb2JsZW1zIHdpdGggdGhlIHRlc3QgaW4gb3JkZXIgdG8gbWFrZSB0ZXN0cyBsZXRzIGZsYWt5 LgorCisgICAgICAgICogbWVkaWEvbm9kZXNGcm9tUmVjdC1zaGFkb3dDb250ZW50Lmh0bWw6Cisg ICAgICAgICogcGxhdGZvcm0vZ3RrL21lZGlhL25vZGVzRnJvbVJlY3Qtc2hhZG93Q29udGVudC1l eHBlY3RlZC50eHQ6CisKIDIwMTItMDQtMTEgIEFudG9uaW8gR29tZXMgIDxhZ29tZXNAcmltLmNv bT4KIAogICAgICAgICBCZSBtb3JlIHJlc3RyaWN0aXZlIHdoZW4gYWRkaW5nIFNjcm9sbGFibGVB cmVhJ3MgdG8gRnJhbWVWaWV3J3MgU2Nyb2xsYWJsZUFyZWEncyBtYXAKZGlmZiAtLWdpdCBhL0xh eW91dFRlc3RzL21lZGlhL25vZGVzRnJvbVJlY3Qtc2hhZG93Q29udGVudC5odG1sIGIvTGF5b3V0 VGVzdHMvbWVkaWEvbm9kZXNGcm9tUmVjdC1zaGFkb3dDb250ZW50Lmh0bWwKaW5kZXggZDU1NjEw YS4uOWZkYWY3ZiAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvbWVkaWEvbm9kZXNGcm9tUmVjdC1z aGFkb3dDb250ZW50Lmh0bWwKKysrIGIvTGF5b3V0VGVzdHMvbWVkaWEvbm9kZXNGcm9tUmVjdC1z aGFkb3dDb250ZW50Lmh0bWwKQEAgLTEzLDExICsxMyw2IEBACiAgIDxzY3JpcHQgdHlwZT0idGV4 dC9qYXZhc2NyaXB0IiBjaGFyc2V0PSJ1dGYtOCI+CiAgICAgZnVuY3Rpb24gcnVuVGVzdCgpCiAg ICAgewotICAgICAgaWYgKHdpbmRvdy5sYXlvdXRUZXN0Q29udHJvbGxlcikgewotICAgICAgICBs YXlvdXRUZXN0Q29udHJvbGxlci5kdW1wQXNUZXh0KCk7Ci0gICAgICAgIGxheW91dFRlc3RDb250 cm9sbGVyLndhaXRVbnRpbERvbmUoKTsKLSAgICAgIH0KLQogICAgICAgdmFyIGUgPSB7fTsKIAog ICAgICAgLy8gU2V0IHVwIHNob3J0Y3V0IGFjY2VzcyB0byBlbGVtZW50cwpAQCAtNDIsMTIgKzM3 LDcgQEAKIAogICAgICAgdmFyIHNoYWRvdyA9Wyctd2Via2l0LW1lZGlhLWNvbnRyb2xzLXRpbWVs aW5lLWNvbnRhaW5lcicsICctd2Via2l0LW1lZGlhLWNvbnRyb2xzLXBsYXktYnV0dG9uJywgJy13 ZWJraXQtbWVkaWEtY29udHJvbHMtcGFuZWwnLCAnLXdlYmtpdC1tZWRpYS1jb250cm9scyddOwog ICAgICAgY2hlY2tTaGFkb3dDb250ZW50KGNsaWNrWCwgY2xpY2tZLCAxMCwgMTAsIDIwLCAyMCwg c2hhZG93KTsKLQotICAgICAgaWYgKHdpbmRvdy5sYXlvdXRUZXN0Q29udHJvbGxlcikKLSAgICAg ICAgbGF5b3V0VGVzdENvbnRyb2xsZXIubm90aWZ5RG9uZSgpOwogICAgIH0KLQotICAgIHdpbmRv dy5vbmxvYWQgPSBydW5UZXN0OwogICA8L3NjcmlwdD4KIDwvaGVhZD4KIDxib2R5IGlkPSJib2R5 Ij4KQEAgLTU4LDYgKzQ4LDcgQEAKICAgICAgICAgdGVzdEV4cGVjdGVkKCJ2aWRlby5jb250cm9s cyIsIG51bGwsICchPScpOwogICAgICAgICB3YWl0Rm9yRXZlbnQoJ2NhbnBsYXl0aHJvdWdoJywg ZnVuY3Rpb24gKCkgewogICAgICAgICAgICAgcnVuVGVzdCgpOworICAgICAgICAgICAgZW5kVGVz dCgpOwogICAgICAgICB9ICk7CiAgICAgICAgIHZpZGVvLnNyYyA9IGZpbmRNZWRpYUZpbGUoInZp ZGVvIiwgImNvbnRlbnQvdGVzdCIpOwogICAgIDwvc2NyaXB0PgpkaWZmIC0tZ2l0IGEvTGF5b3V0 VGVzdHMvcGxhdGZvcm0vZ3RrL21lZGlhL25vZGVzRnJvbVJlY3Qtc2hhZG93Q29udGVudC1leHBl Y3RlZC50eHQgYi9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9ndGsvbWVkaWEvbm9kZXNGcm9tUmVjdC1z aGFkb3dDb250ZW50LWV4cGVjdGVkLnR4dAppbmRleCAzOTBlNzNlLi4zNzFmMzkzIDEwMDY0NAot LS0gYS9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9ndGsvbWVkaWEvbm9kZXNGcm9tUmVjdC1zaGFkb3dD b250ZW50LWV4cGVjdGVkLnR4dAorKysgYi9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9ndGsvbWVkaWEv bm9kZXNGcm9tUmVjdC1zaGFkb3dDb250ZW50LWV4cGVjdGVkLnR4dApAQCAtNCw0ICs0LDUgQEAg VGhpcyB0ZXN0IG9ubHkgcnVucyBpbiBEUlQhCiAKIEVYUEVDVEVEICh2aWRlby5jb250cm9scyAh PSAnbnVsbCcpIE9LCiBFVkVOVChjYW5wbGF5dGhyb3VnaCkKK0VORCBPRiBURVNUCiAKZGlmZiAt LWdpdCBhL0xheW91dFRlc3RzL3BsYXRmb3JtL21hYy9Ta2lwcGVkIGIvTGF5b3V0VGVzdHMvcGxh dGZvcm0vbWFjL1NraXBwZWQKaW5kZXggNGY2MWQ3Yi4uMjJiMDcwNSAxMDA2NDQKLS0tIGEvTGF5 b3V0VGVzdHMvcGxhdGZvcm0vbWFjL1NraXBwZWQKKysrIGIvTGF5b3V0VGVzdHMvcGxhdGZvcm0v bWFjL1NraXBwZWQKQEAgLTc4Nyw4ICs3ODcsNSBAQCBmYXN0L2NhbnZhcy93ZWJnbC9hcnJheS1t ZXNzYWdlLXBhc3NpbmcuaHRtbAogIyBidXQgbm90IHRoZSBpbm5lcldpZHRoLiBUaGUgdGVzdCBw YXNzZXMgb24gUXQsIEdUSyBhbmQgQ2hyb21pdW0uCiBmYXN0L2Nzcy9hbGlnbi1wb3NpdGlvbmVk LW9iamVjdC1vbi1yZXNpemUuaHRtbAogCi0jIGh0dHBzOi8vYnVncy53ZWJraXQub3JnL3Nob3df YnVnLmNnaT9pZD04MzQxMQotbWVkaWEvbm9kZXNGcm9tUmVjdC1zaGFkb3dDb250ZW50Lmh0bWwK LQogIyBodHRwczovL2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9ODM2MTgKIGZhc3Qv ZG9tL2lubGluZS1ldmVudC1hdHRyaWJ1dGVzLXJlbGVhc2UuaHRtbAotLSAKMS43LjUuNAoK 136826 2012-04-11 22:29:26 -0700 2012-04-11 23:05:45 -0700 rebaseline 0001-Unreviewed-rebaseline.patch text/plain 1343 tonikitoo RnJvbSA5ZjgyZjYyY2EzZjhhZGE4YWFmZTE2NDliMzQ2YjcxMGFjZWYxOWRlIE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiBBbnRvbmlvIEdvbWVzIDxhZ29tZXNAcmltLmNvbT4KRGF0ZTog VGh1LCAxMiBBcHIgMjAxMiAwMToxOTo1MyAtMDQwMApTdWJqZWN0OiBbUEFUQ0hdIFVucmV2aWV3 ZWQgcmViYXNlbGluZS4KCiogbWVkaWEvbm9kZXNGcm9tUmVjdC1zaGFkb3dDb250ZW50LWV4cGVj dGVkLnR4dDoKLS0tCiBMYXlvdXRUZXN0cy9DaGFuZ2VMb2cgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICB8ICAgIDYgKysrKysrCiAuLi4vbWVkaWEvbm9kZXNGcm9tUmVjdC1zaGFkb3dDb250 ZW50LWV4cGVjdGVkLnR4dCB8ICAgIDIgKysKIDIgZmlsZXMgY2hhbmdlZCwgOCBpbnNlcnRpb25z KCspLCAwIGRlbGV0aW9ucygtKQoKZGlmZiAtLWdpdCBhL0xheW91dFRlc3RzL0NoYW5nZUxvZyBi L0xheW91dFRlc3RzL0NoYW5nZUxvZwppbmRleCBkNDQ0OTU4Li5kYzEzZTlkIDEwMDY0NAotLS0g YS9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKKysrIGIvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCkBAIC0x LDMgKzEsOSBAQAorMjAxMi0wNC0xMSAgQW50b25pbyBHb21lcyAgPGFnb21lc0ByaW0uY29tPgor CisgICAgICAgIFVucmV2aWV3ZWQgcmViYXNlbGluZS4KKworICAgICAgICAqIG1lZGlhL25vZGVz RnJvbVJlY3Qtc2hhZG93Q29udGVudC1leHBlY3RlZC50eHQ6CisKIDIwMTItMDQtMTEgIEZpbGlw IFBpemxvICA8ZnBpemxvQGFwcGxlLmNvbT4KIAogICAgICAgICBJdCBpcyBpbmNvcnJlY3QgdG8g c2hvcnQtY2lyY3VpdCBCcmFuY2goTG9naWNhbE5vdChAYSkpIGlmIGJvb2xlYW4gc3BlY3VsYXRp b25zIG9uIEBhIG1heSBmYWlsCmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9tZWRpYS9ub2Rlc0Zy b21SZWN0LXNoYWRvd0NvbnRlbnQtZXhwZWN0ZWQudHh0IGIvTGF5b3V0VGVzdHMvbWVkaWEvbm9k ZXNGcm9tUmVjdC1zaGFkb3dDb250ZW50LWV4cGVjdGVkLnR4dAppbmRleCA2NjYyODJlLi4zNzFm MzkzIDEwMDY0NAotLS0gYS9MYXlvdXRUZXN0cy9tZWRpYS9ub2Rlc0Zyb21SZWN0LXNoYWRvd0Nv bnRlbnQtZXhwZWN0ZWQudHh0CisrKyBiL0xheW91dFRlc3RzL21lZGlhL25vZGVzRnJvbVJlY3Qt c2hhZG93Q29udGVudC1leHBlY3RlZC50eHQKQEAgLTMsNCArMyw2IEBAIFBBU1MgQWxsIGNvcnJl Y3Qgbm9kZXMgZm91bmQgZm9yIHJlY3QKIFRoaXMgdGVzdCBvbmx5IHJ1bnMgaW4gRFJUIQogCiBF WFBFQ1RFRCAodmlkZW8uY29udHJvbHMgIT0gJ251bGwnKSBPSworRVZFTlQoY2FucGxheXRocm91 Z2gpCitFTkQgT0YgVEVTVAogCi0tIAoxLjcuNS40Cgo=