107184 2013-01-17 14:57:43 -0800 HTTP 500 error between QueueStatusServer and bot(s) 2013-01-30 21:19:42 -0800 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) Unspecified Unspecified RESOLVED FIXED P2 Normal --- 1 alancutter alancutter abarth dpranke eric pdr webkit.review.bot oldest_to_newest 809836 0 alancutter 2013-01-17 14:57:43 -0800 The feeder queue is frequently blocked for over 8 minutes at a time. feeder-queue logs: > Feeding commit-queue items [182076, 183087] > Feeding EWS (551 r? patches, 14 new) > Submitting attachment 124896 to EWS queues > Submitting attachment 183107 to EWS queues > Submitting attachment 179684 to EWS queues > Submitting attachment 183109 to EWS queues > Submitting attachment 158695 to EWS queues > Submitting attachment 120296 to EWS queues > Submitting attachment 182256 to EWS queues > Submitting attachment 157608 to EWS queues > Submitting attachment 179699 to EWS queues > Submitting attachment 177748 to EWS queues > Submitting attachment 158718 to EWS queues > Submitting attachment 167385 to EWS queues > Received HTTP status 500 loading "None". Retrying in 10 seconds... > Received HTTP status 500 loading "None". Retrying in 15.0 seconds... > Received HTTP status 500 loading "None". Retrying in 22.5 seconds... > Received HTTP status 500 loading "None". Retrying in 33.75 seconds... > Received HTTP status 500 loading "None". Retrying in 50.625 seconds... > Received HTTP status 500 loading "None". Retrying in 75.9375 seconds... > Received HTTP status 500 loading "None". Retrying in 113.90625 seconds... > Received HTTP status 500 loading "None". Retrying in 170.859375 seconds... > Traceback (most recent call last): > File "/mnt/git/webkit-feeder-queue/Tools/Scripts/webkitpy/tool/bot/queueengine.py", line 105, in run > if not self._delegate.process_work_item(work_item): > File "/mnt/git/webkit-feeder-queue/Tools/Scripts/webkitpy/tool/commands/queues.py", line 196, in process_work_item > feeder.feed() > File "/mnt/git/webkit-feeder-queue/Tools/Scripts/webkitpy/tool/bot/feeders.py", line 97, in feed > self._tool.status_server.submit_to_ews(attachment_id) > File "/mnt/git/webkit-feeder-queue/Tools/Scripts/webkitpy/common/net/statusserver.py", line 123, in submit_to_ews > return NetworkTransaction().run(lambda: self._post_work_item_to_ews(attachment_id)) > File "/mnt/git/webkit-feeder-queue/Tools/Scripts/webkitpy/common/net/networktransaction.py", line 57, in run > self._check_for_timeout() > File "/mnt/git/webkit-feeder-queue/Tools/Scripts/webkitpy/common/net/networktransaction.py", line 63, in _check_for_timeout > raise NetworkTimeout() > NetworkTimeout: NetworkTimeout > Exception while preparing queue Sleeping until 2013-01-17 04:52:19 (2 mins). The QueueStatusServer frequently throws HTTP 500 errors. QSS logs: Recent errors: > 2013-01-16 21:21:35.024 /submit-to-ews 500 750ms 2kb Python-urllib/2.6 > E 2013-01-16 21:21:35.017 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:18:43.200 /submit-to-ews 500 517ms 2kb Python-urllib/2.6 > E 2013-01-16 21:18:43.197 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:16:48.409 /submit-to-ews 500 416ms 2kb Python-urllib/2.6 > E 2013-01-16 21:16:48.394 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:15:31.652 /submit-to-ews 500 493ms 2kb Python-urllib/2.6 > E 2013-01-16 21:15:31.650 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:14:40.224 /submit-to-ews 500 1150ms 2kb Python-urllib/2.6 > E 2013-01-16 21:14:40.218 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:14:04.705 /submit-to-ews 500 327ms 2kb Python-urllib/2.6 > E 2013-01-16 21:14:04.703 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:13:41.396 /submit-to-ews 500 464ms 2kb Python-urllib/2.6 > E 2013-01-16 21:13:41.394 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:13:25.793 /submit-to-ews 500 327ms 2kb Python-urllib/2.6 > E 2013-01-16 21:13:25.790 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:13:15.324 /submit-to-ews 500 391ms 2kb Python-urllib/2.6 > E 2013-01-16 21:13:15.322 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:11:09.632 /submit-to-ews 500 1127ms 2kb Python-urllib/2.6 > E 2013-01-16 21:11:09.619 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:08:17.301 /submit-to-ews 500 853ms 2kb Python-urllib/2.6 > E 2013-01-16 21:08:17.299 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:06:22.207 /submit-to-ews 500 347ms 2kb Python-urllib/2.6 > E 2013-01-16 21:06:22.205 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:05:05.513 /submit-to-ews 500 512ms 2kb Python-urllib/2.6 > E 2013-01-16 21:05:05.512 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:04:13.935 /submit-to-ews 500 312ms 2kb Python-urllib/2.6 > E 2013-01-16 21:04:13.933 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:03:39.489 /submit-to-ews 500 708ms 2kb Python-urllib/2.6 > E 2013-01-16 21:03:39.487 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib > 2013-01-16 21:03:16.167 /submit-to-ews 500 717ms 2kb Python-urllib/2.6 > E 2013-01-16 21:03:16.159 Values may not be more than 1000000 bytes in length; received 1054167 bytes Traceback (most recent call last): File "/base/python_runtime/python_lib Single error detail: > 2013-01-16 21:15:31.652 /submit-to-ews 500 493ms 2kb Python-urllib/2.6 > 8.34.213.203 - - [16/Jan/2013:21:15:31 -0800] "POST /submit-to-ews HTTP/1.1" 500 2132 "http://queues.webkit.org/submit-to-ews" "Python-urllib/2.6" "queues.webkit.org" ms=493 cpu_ms=107 cpm_usd=0.000238 instance=00c61b117c8dc6bb676ce419546a20bc69ae89 > E 2013-01-16 21:15:31.650 > Values may not be more than 1000000 bytes in length; received 1054167 bytes > Traceback (most recent call last): > File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/webapp/_webapp25.py", line 716, in __call__ > handler.post(*groups) > File "/base/data/home/apps/webkit-commit-queue/1.364503684603662849/handlers/submittoews.py", line 64, in post > self._add_attachment_to_ews_queues(attachment) > File "/base/data/home/apps/webkit-commit-queue/1.364503684603662849/handlers/submittoews.py", line 58, in _add_attachment_to_ews_queues > if self._should_add_to_ews_queue(queue, attachment): > File "/base/data/home/apps/webkit-commit-queue/1.364503684603662849/handlers/submittoews.py", line 46, in _should_add_to_ews_queue > latest_status = attachment.status_for_queue(queue) > File "/base/data/home/apps/webkit-commit-queue/1.364503684603662849/model/attachment.py", line 95, in status_for_queue > queue_summary = self.summary().get(queue.name_with_underscores()) > File "/base/data/home/apps/webkit-commit-queue/1.364503684603662849/model/attachment.py", line 73, in summary > memcache.set(str(self.id), self._summary, namespace="attachment-summary") > File "/base/python_runtime/python_lib/versions/1/google/appengine/api/memcache/__init__.py", line 793, in set > namespace=namespace) > File "/base/python_runtime/python_lib/versions/1/google/appengine/api/memcache/__init__.py", line 898, in _set_with_policy > time, '', namespace) > File "/base/python_runtime/python_lib/versions/1/google/appengine/api/memcache/__init__.py", line 977, in _set_multi_async_with_policy > stored_value, flags = _validate_encode_value(value, self._do_pickle) > File "/base/python_runtime/python_lib/versions/1/google/appengine/api/memcache/__init__.py", line 236, in _validate_encode_value > 'received %d bytes' % (MAX_VALUE_SIZE, len(stored_value))) > ValueError: Values may not be more than 1000000 bytes in length; received 1054167 bytes These are probably related and may account for the unusual consistently spiky requests/s graph in App Engine. 809924 1 abarth 2013-01-17 16:14:23 -0800 Which value is getting too big? We've seen this in the past when there's a queue that hasn't been processing for a long time and has lots of work to do... 811533 2 pdr 2013-01-19 18:55:06 -0800 *** Bug 107388 has been marked as a duplicate of this bug. *** 816216 3 184662 alancutter 2013-01-24 22:02:57 -0800 Created attachment 184662 Patch 816218 4 alancutter 2013-01-24 22:05:47 -0800 (In reply to comment #3) > Created an attachment (id=184662) [details] > Patch Patch removes the use of memcache from the Attachment class. 816219 5 184662 abarth 2013-01-24 22:05:49 -0800 Comment on attachment 184662 Patch View in context: https://bugs.webkit.org/attachment.cgi?id=184662&action=review > Tools/QueueStatusServer/model/attachment.py:-41 > - def dirty(cls, attachment_id): > - memcache.delete(str(attachment_id), namespace="attachment-summary") Don't we need to remove the caller of this function in updatestate.py? 816225 6 184664 alancutter 2013-01-24 22:11:26 -0800 Created attachment 184664 Patch 816226 7 alancutter 2013-01-24 22:12:21 -0800 (In reply to comment #5) > (From update of attachment 184662 [details]) > View in context: https://bugs.webkit.org/attachment.cgi?id=184662&action=review > > > Tools/QueueStatusServer/model/attachment.py:-41 > > - def dirty(cls, attachment_id): > > - memcache.delete(str(attachment_id), namespace="attachment-summary") > > Don't we need to remove the caller of this function in updatestate.py? Thanks for catching that, removed all calls to Attachment.dirty(). 816267 8 184664 eric 2013-01-24 22:53:15 -0800 Comment on attachment 184664 Patch This is OK. Presumably we'll have to implement a replacement for what we were attempting to cache. :) 816271 9 184664 webkit.review.bot 2013-01-24 22:56:40 -0800 Comment on attachment 184664 Patch Rejecting attachment 184664 from commit-queue. Failed to run "['/mnt/git/webkit-commit-queue/Tools/Scripts/webkit-patch', '--status-host=queues.webkit.org', '--bot-id=gce-cq-02', 'apply-attachment', '--no-update', '--non-interactive', 184664, '--port=chromium-xvfb']" exit_code: 2 cwd: /mnt/git/webkit-commit-queue Last 500 characters of output: ply', '--force', '--reviewer', 'Adam Barth']" exit_code: 2 cwd: /mnt/git/webkit-commit-queue Parsed 3 diffs from patch file(s). patch: **** Can't create file /tmp/ppCBCh5i : No space left on device patch: **** Can't create file /tmp/ppBG1Tdm : No space left on device patch: **** Can't create file /tmp/ppMfF0Ml : No space left on device Failed to run "[u'/mnt/git/webkit-commit-queue/Tools/Scripts/svn-apply', '--force', '--reviewer', 'Adam Barth']" exit_code: 2 cwd: /mnt/git/webkit-commit-queue Full output: http://queues.webkit.org/results/16120144 816279 10 184664 abarth 2013-01-24 23:01:31 -0800 Comment on attachment 184664 Patch Clearing flags on attachment: 184664 Committed r140786: <http://trac.webkit.org/changeset/140786> 816280 11 abarth 2013-01-24 23:01:35 -0800 All reviewed patches have been landed. Closing bug. 821055 12 alancutter 2013-01-30 21:19:42 -0800 *** Bug 75024 has been marked as a duplicate of this bug. *** 184662 2013-01-24 22:02:57 -0800 2013-01-24 22:11:23 -0800 Patch bug-107184-20130125165947.patch text/plain 2141 alancutter U3VidmVyc2lvbiBSZXZpc2lvbjogMTQwNzc5CmRpZmYgLS1naXQgYS9Ub29scy9DaGFuZ2VMb2cg Yi9Ub29scy9DaGFuZ2VMb2cKaW5kZXggZDc1ZDE4NGM5ZDRlYjE3MzUyNzNkM2U0M2I2ZTVhMGFi OTA1YTUzNy4uZjg1MjJkN2NjZTdlOGM5NDdlNGZjNzNlMDk5OWE5YjRkMWJiOGUzMCAxMDA2NDQK LS0tIGEvVG9vbHMvQ2hhbmdlTG9nCisrKyBiL1Rvb2xzL0NoYW5nZUxvZwpAQCAtMSwzICsxLDE2 IEBACisyMDEzLTAxLTI0ICBBbGFuIEN1dHRlciAgPGFsYW5jdXR0ZXJAY2hyb21pdW0ub3JnPgor CisgICAgICAgIEhUVFAgNTAwIGVycm9yIGJldHdlZW4gUXVldWVTdGF0dXNTZXJ2ZXIgYW5kIGJv dChzKQorICAgICAgICBodHRwczovL2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9MTA3 MTg0CisKKyAgICAgICAgUmV2aWV3ZWQgYnkgTk9CT0RZIChPT1BTISkuCisKKyAgICAgICAgUmVt b3ZlZCB0aGUgdXNlIG9mIG1lbWNhY2hlIHdoaWNoIHdhcyB0aGUgc291cmNlIG9mIHRoZSBleGNl cHRpb24uCisKKyAgICAgICAgKiBRdWV1ZVN0YXR1c1NlcnZlci9tb2RlbC9hdHRhY2htZW50LnB5 OgorICAgICAgICAoQXR0YWNobWVudCk6CisgICAgICAgIChBdHRhY2htZW50LnN1bW1hcnkpOgor CiAyMDEzLTAxLTI0ICBFcmljIFNlaWRlbCAgPGVyaWNAd2Via2l0Lm9yZz4KIAogICAgICAgICBT a2lwIGhhc2xhbmRlZF91bml0dGVzdC5weSBvbiBzeXN0ZW1zIHdoaWNoIGRvIG5vdCBoYXZlIGlu dGVyZGlmZiBpbnN0YWxsZWQKZGlmZiAtLWdpdCBhL1Rvb2xzL1F1ZXVlU3RhdHVzU2VydmVyL21v ZGVsL2F0dGFjaG1lbnQucHkgYi9Ub29scy9RdWV1ZVN0YXR1c1NlcnZlci9tb2RlbC9hdHRhY2ht ZW50LnB5CmluZGV4IGY5OGYyNjVlNmNmYWZiNGE3ODFhYjU1ZDYxODVhOWRlMTAxZjJiYTguLjgz YjQ0MWVkY2M4MzkwOWE5ZWJkMDBhZjQ5ZWY4YzkwMWMwNWMyMjIgMTAwNjQ0Ci0tLSBhL1Rvb2xz L1F1ZXVlU3RhdHVzU2VydmVyL21vZGVsL2F0dGFjaG1lbnQucHkKKysrIGIvVG9vbHMvUXVldWVT dGF0dXNTZXJ2ZXIvbW9kZWwvYXR0YWNobWVudC5weQpAQCAtMjgsOCArMjgsNiBAQAogCiBpbXBv cnQgcmUKIAotZnJvbSBnb29nbGUuYXBwZW5naW5lLmFwaSBpbXBvcnQgbWVtY2FjaGUKLQogZnJv bSBtb2RlbC5xdWV1ZXMgaW1wb3J0IFF1ZXVlCiBmcm9tIG1vZGVsLnF1ZXVlc3RhdHVzIGltcG9y dCBRdWV1ZVN0YXR1cwogZnJvbSBtb2RlbC53b3JraXRlbXMgaW1wb3J0IFdvcmtJdGVtcwpAQCAt MzcsMTAgKzM1LDYgQEAgZnJvbSBtb2RlbC53b3JraXRlbXMgaW1wb3J0IFdvcmtJdGVtcwogCiBj bGFzcyBBdHRhY2htZW50KG9iamVjdCk6CiAgICAgQGNsYXNzbWV0aG9kCi0gICAgZGVmIGRpcnR5 KGNscywgYXR0YWNobWVudF9pZCk6Ci0gICAgICAgIG1lbWNhY2hlLmRlbGV0ZShzdHIoYXR0YWNo bWVudF9pZCksIG5hbWVzcGFjZT0iYXR0YWNobWVudC1zdW1tYXJ5IikKLQotICAgIEBjbGFzc21l dGhvZAogICAgIGRlZiByZWNlbnQoY2xzLCBsaW1pdD0xKToKICAgICAgICAgc3RhdHVzZXMgPSBR dWV1ZVN0YXR1cy5hbGwoKS5vcmRlcigiLWRhdGUiKQogICAgICAgICAjIE5vdGljZSB0aGF0IHdl IHVzZSBib3RoIGEgc2V0IGFuZCBhIGxpc3QgaGVyZSB0byBrZWVwIHRoZSAtZGF0ZSBvcmRlcmlu Zy4KQEAgLTY2LDExICs2MCw3IEBAIGNsYXNzIEF0dGFjaG1lbnQob2JqZWN0KToKICAgICBkZWYg c3VtbWFyeShzZWxmKToKICAgICAgICAgaWYgc2VsZi5fc3VtbWFyeToKICAgICAgICAgICAgIHJl dHVybiBzZWxmLl9zdW1tYXJ5Ci0gICAgICAgIHNlbGYuX3N1bW1hcnkgPSBtZW1jYWNoZS5nZXQo c3RyKHNlbGYuaWQpLCBuYW1lc3BhY2U9ImF0dGFjaG1lbnQtc3VtbWFyeSIpCi0gICAgICAgIGlm IHNlbGYuX3N1bW1hcnk6Ci0gICAgICAgICAgICByZXR1cm4gc2VsZi5fc3VtbWFyeQogICAgICAg ICBzZWxmLl9zdW1tYXJ5ID0gc2VsZi5fZmV0Y2hfc3VtbWFyeSgpCi0gICAgICAgIG1lbWNhY2hl LnNldChzdHIoc2VsZi5pZCksIHNlbGYuX3N1bW1hcnksIG5hbWVzcGFjZT0iYXR0YWNobWVudC1z dW1tYXJ5IikKICAgICAgICAgcmV0dXJuIHNlbGYuX3N1bW1hcnkKIAogICAgIGRlZiBzdGF0ZV9m cm9tX3F1ZXVlX3N0YXR1cyhzZWxmLCBzdGF0dXMpOgo= 184664 2013-01-24 22:11:26 -0800 2013-01-24 23:01:31 -0800 Patch bug-107184-20130125170817.patch text/plain 2951 alancutter U3VidmVyc2lvbiBSZXZpc2lvbjogMTQwNzc5CmRpZmYgLS1naXQgYS9Ub29scy9DaGFuZ2VMb2cg Yi9Ub29scy9DaGFuZ2VMb2cKaW5kZXggZDc1ZDE4NGM5ZDRlYjE3MzUyNzNkM2U0M2I2ZTVhMGFi OTA1YTUzNy4uNjFkMjFlYzE2ZjQ4ZGNmODIzZTg3NDE0OTUxNTE2ZjVmNzE5YzljZCAxMDA2NDQK LS0tIGEvVG9vbHMvQ2hhbmdlTG9nCisrKyBiL1Rvb2xzL0NoYW5nZUxvZwpAQCAtMSwzICsxLDE4 IEBACisyMDEzLTAxLTI0ICBBbGFuIEN1dHRlciAgPGFsYW5jdXR0ZXJAY2hyb21pdW0ub3JnPgor CisgICAgICAgIEhUVFAgNTAwIGVycm9yIGJldHdlZW4gUXVldWVTdGF0dXNTZXJ2ZXIgYW5kIGJv dChzKQorICAgICAgICBodHRwczovL2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9MTA3 MTg0CisKKyAgICAgICAgUmV2aWV3ZWQgYnkgTk9CT0RZIChPT1BTISkuCisKKyAgICAgICAgUmVt b3ZlZCB0aGUgdXNlIG9mIG1lbWNhY2hlIHdoaWNoIHdhcyB0aGUgc291cmNlIG9mIHRoZSBleGNl cHRpb24uCisKKyAgICAgICAgKiBRdWV1ZVN0YXR1c1NlcnZlci9oYW5kbGVycy91cGRhdGVzdGF0 dXMucHk6CisgICAgICAgIChVcGRhdGVTdGF0dXMucG9zdCk6CisgICAgICAgICogUXVldWVTdGF0 dXNTZXJ2ZXIvbW9kZWwvYXR0YWNobWVudC5weToKKyAgICAgICAgKEF0dGFjaG1lbnQpOgorICAg ICAgICAoQXR0YWNobWVudC5zdW1tYXJ5KToKKwogMjAxMy0wMS0yNCAgRXJpYyBTZWlkZWwgIDxl cmljQHdlYmtpdC5vcmc+CiAKICAgICAgICAgU2tpcCBoYXNsYW5kZWRfdW5pdHRlc3QucHkgb24g c3lzdGVtcyB3aGljaCBkbyBub3QgaGF2ZSBpbnRlcmRpZmYgaW5zdGFsbGVkCmRpZmYgLS1naXQg YS9Ub29scy9RdWV1ZVN0YXR1c1NlcnZlci9oYW5kbGVycy91cGRhdGVzdGF0dXMucHkgYi9Ub29s cy9RdWV1ZVN0YXR1c1NlcnZlci9oYW5kbGVycy91cGRhdGVzdGF0dXMucHkKaW5kZXggYTBlNzE5 NGFkZTg4M2I2MmE1NWZmNGE0MzBlMGY3ZDM4OTViZmJmYS4uYjAyZTk4NzZhOGFhN2Y3MjlhOThm NGNkZGVkYjAwOTg5ZGFkZjRjNSAxMDA2NDQKLS0tIGEvVG9vbHMvUXVldWVTdGF0dXNTZXJ2ZXIv aGFuZGxlcnMvdXBkYXRlc3RhdHVzLnB5CisrKyBiL1Rvb2xzL1F1ZXVlU3RhdHVzU2VydmVyL2hh bmRsZXJzL3VwZGF0ZXN0YXR1cy5weQpAQCAtNjcsNSArNjcsNCBAQCBjbGFzcyBVcGRhdGVTdGF0 dXMoVXBkYXRlQmFzZSk6CiAgICAgICAgIFJlY29yZEJvdEV2ZW50LnJlY29yZF9hY3Rpdml0eShx dWV1ZV9zdGF0dXMucXVldWVfbmFtZSwgcXVldWVfc3RhdHVzLmJvdF9pZCkKICAgICAgICAgaWYg cXVldWVfc3RhdHVzLmFjdGl2ZV9wYXRjaF9pZDoKICAgICAgICAgICAgIFJlY29yZFBhdGNoRXZl bnQudXBkYXRlZChxdWV1ZV9zdGF0dXMuYWN0aXZlX3BhdGNoX2lkLCBxdWV1ZV9zdGF0dXMucXVl dWVfbmFtZSwgcXVldWVfc3RhdHVzLmJvdF9pZCkKLSAgICAgICAgQXR0YWNobWVudC5kaXJ0eShx dWV1ZV9zdGF0dXMuYWN0aXZlX3BhdGNoX2lkKQogICAgICAgICBzZWxmLnJlc3BvbnNlLm91dC53 cml0ZShxdWV1ZV9zdGF0dXMua2V5KCkuaWQoKSkKZGlmZiAtLWdpdCBhL1Rvb2xzL1F1ZXVlU3Rh dHVzU2VydmVyL21vZGVsL2F0dGFjaG1lbnQucHkgYi9Ub29scy9RdWV1ZVN0YXR1c1NlcnZlci9t b2RlbC9hdHRhY2htZW50LnB5CmluZGV4IGY5OGYyNjVlNmNmYWZiNGE3ODFhYjU1ZDYxODVhOWRl MTAxZjJiYTguLjgzYjQ0MWVkY2M4MzkwOWE5ZWJkMDBhZjQ5ZWY4YzkwMWMwNWMyMjIgMTAwNjQ0 Ci0tLSBhL1Rvb2xzL1F1ZXVlU3RhdHVzU2VydmVyL21vZGVsL2F0dGFjaG1lbnQucHkKKysrIGIv VG9vbHMvUXVldWVTdGF0dXNTZXJ2ZXIvbW9kZWwvYXR0YWNobWVudC5weQpAQCAtMjgsOCArMjgs NiBAQAogCiBpbXBvcnQgcmUKIAotZnJvbSBnb29nbGUuYXBwZW5naW5lLmFwaSBpbXBvcnQgbWVt Y2FjaGUKLQogZnJvbSBtb2RlbC5xdWV1ZXMgaW1wb3J0IFF1ZXVlCiBmcm9tIG1vZGVsLnF1ZXVl c3RhdHVzIGltcG9ydCBRdWV1ZVN0YXR1cwogZnJvbSBtb2RlbC53b3JraXRlbXMgaW1wb3J0IFdv cmtJdGVtcwpAQCAtMzcsMTAgKzM1LDYgQEAgZnJvbSBtb2RlbC53b3JraXRlbXMgaW1wb3J0IFdv cmtJdGVtcwogCiBjbGFzcyBBdHRhY2htZW50KG9iamVjdCk6CiAgICAgQGNsYXNzbWV0aG9kCi0g ICAgZGVmIGRpcnR5KGNscywgYXR0YWNobWVudF9pZCk6Ci0gICAgICAgIG1lbWNhY2hlLmRlbGV0 ZShzdHIoYXR0YWNobWVudF9pZCksIG5hbWVzcGFjZT0iYXR0YWNobWVudC1zdW1tYXJ5IikKLQot ICAgIEBjbGFzc21ldGhvZAogICAgIGRlZiByZWNlbnQoY2xzLCBsaW1pdD0xKToKICAgICAgICAg c3RhdHVzZXMgPSBRdWV1ZVN0YXR1cy5hbGwoKS5vcmRlcigiLWRhdGUiKQogICAgICAgICAjIE5v dGljZSB0aGF0IHdlIHVzZSBib3RoIGEgc2V0IGFuZCBhIGxpc3QgaGVyZSB0byBrZWVwIHRoZSAt ZGF0ZSBvcmRlcmluZy4KQEAgLTY2LDExICs2MCw3IEBAIGNsYXNzIEF0dGFjaG1lbnQob2JqZWN0 KToKICAgICBkZWYgc3VtbWFyeShzZWxmKToKICAgICAgICAgaWYgc2VsZi5fc3VtbWFyeToKICAg ICAgICAgICAgIHJldHVybiBzZWxmLl9zdW1tYXJ5Ci0gICAgICAgIHNlbGYuX3N1bW1hcnkgPSBt ZW1jYWNoZS5nZXQoc3RyKHNlbGYuaWQpLCBuYW1lc3BhY2U9ImF0dGFjaG1lbnQtc3VtbWFyeSIp Ci0gICAgICAgIGlmIHNlbGYuX3N1bW1hcnk6Ci0gICAgICAgICAgICByZXR1cm4gc2VsZi5fc3Vt bWFyeQogICAgICAgICBzZWxmLl9zdW1tYXJ5ID0gc2VsZi5fZmV0Y2hfc3VtbWFyeSgpCi0gICAg ICAgIG1lbWNhY2hlLnNldChzdHIoc2VsZi5pZCksIHNlbGYuX3N1bW1hcnksIG5hbWVzcGFjZT0i YXR0YWNobWVudC1zdW1tYXJ5IikKICAgICAgICAgcmV0dXJuIHNlbGYuX3N1bW1hcnkKIAogICAg IGRlZiBzdGF0ZV9mcm9tX3F1ZXVlX3N0YXR1cyhzZWxmLCBzdGF0dXMpOgo=