97465 2012-09-24 10:33:05 -0700 test-webkitpy fails on windows when running with more than one child process 2012-09-25 15:23:40 -0700 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) Unspecified Unspecified RESOLVED FIXED P2 Normal --- 1 lforschler webkit-unassigned lforschler roger_fong thorton webkit.review.bot oldest_to_newest 726816 0 lforschler 2012-09-24 10:33:05 -0700 On the mac windows debug test bot, the python tests are constantly failing. I've noticed that passing in -j 1 (to run with only one child process) seems to fix the issue. the stack trace is as follows: $ python ./Tools/Scripts/test-webkitpy -v -j 2 Suppressing most webkitpy logging while running unit tests. Skipping tests in the following modules or packages because they are really, lly, slow: webkitpy.common.checkout.scm.scm_unittest (https://bugs.webkit.org/show_bug.cgi?id=31818; use --all to include) Running the tests ...Traceback (most recent call last): File "/home/buildbot/slave/windows-debug-tests/build/OpenSource/Tools/Scri webkitpy/test/main.py", line 227, in <module> sys.exit(main()) File "/home/buildbot/slave/windows-debug-tests/build/OpenSource/Tools/Scri webkitpy/test/main.py", line 69, in main return not tester.run() File "/home/buildbot/slave/windows-debug-tests/build/OpenSource/Tools/Scri webkitpy/test/main.py", line 119, in run return self._run_tests(names) File "/home/buildbot/slave/windows-debug-tests/build/OpenSource/Tools/Scri webkitpy/test/main.py", line 154, in _run_tests test_runner.run(parallel_tests, self._options.child_processes) File "/home/buildbot/slave/windows-debug-tests/build/OpenSource/Tools/Scri webkitpy/test/runner.py", line 52, in run with message_pool.get(self, self.worker_factory, num_workers) as pool: File "/home/buildbot/slave/windows-debug-tests/build/OpenSource/Tools/Scri webkitpy/common/message_pool.py", line 61, in get return _MessagePool(caller, worker_factory, num_workers, worker_startup_ y_secs, host) File "/home/buildbot/slave/windows-debug-tests/build/OpenSource/Tools/Scri webkitpy/common/message_pool.py", line 79, in __init__ self._messages_to_worker = multiprocessing.Queue() File "/usr/lib/python2.6/multiprocessing/__init__.py", line 213, in Queue return Queue(maxsize) File "/usr/lib/python2.6/multiprocessing/queues.py", line 37, in __init__ self._rlock = Lock() File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 117, in __i _ SemLock.__init__(self, SEMAPHORE, 1, 1) File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 49, in __in sl = self._semlock = _multiprocessing.SemLock(kind, value, maxvalue) OSError: [Errno 17] File exists 726819 1 lforschler 2012-09-24 10:35:11 -0700 On the one mac bot we have, running with j=1 takes about 70 seconds. It is not significantly faster running parallel (around 40 seconds), so we could turn off parallel running to get the bot back online. 726847 2 165412 lforschler 2012-09-24 11:03:24 -0700 Created attachment 165412 Tell Windows bot to use only one child process 727991 3 165412 thorton 2012-09-25 14:59:28 -0700 Comment on attachment 165412 Tell Windows bot to use only one child process Is there a bug to actually fix the failure? 728013 4 165412 webkit.review.bot 2012-09-25 15:23:37 -0700 Comment on attachment 165412 Tell Windows bot to use only one child process Clearing flags on attachment: 165412 Committed r129561: <http://trac.webkit.org/changeset/129561> 728014 5 webkit.review.bot 2012-09-25 15:23:40 -0700 All reviewed patches have been landed. Closing bug. 165412 2012-09-24 11:03:24 -0700 2012-09-25 15:23:37 -0700 Tell Windows bot to use only one child process 97465.patch text/plain 1646 lforschler SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl dmlzaW9uIDEyOTM4NykKKysrIFRvb2xzL0NoYW5nZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwz ICsxLDEzIEBACisyMDEyLTA5LTI0ICBMdWNhcyBGb3JzY2hsZXIgIDxsZm9yc2NobGVyQGFwcGxl LmNvbT4KKworICAgICAgICBQeXRob24gdGVzdHMgZmFpbCBvbiBXaW5kb3dzIGJvdHMgd2hlbiBy dW5uaW5nIHdpdGggbW9yZSB0aGFuIG9uZSBjaGlsZCBwcm9jZXNzLiAgVGVtcG9yYXJpbHkgdXNl IG9ubHkgb25lIGNoaWxkIHByb2Nlc3MgdW50aWwgdGhlIHByb2JsZW0gY2FuIGJlIGZpeGVkLgor ICAgICAgICBodHRwczovL2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9OTc0NjUKKyAg ICAgICAgCisgICAgICAgIFJldmlld2VkIGJ5IE5PQk9EWSAoT09QUyEpLgorCisgICAgICAgICog QnVpbGRTbGF2ZVN1cHBvcnQvYnVpbGQud2Via2l0Lm9yZy1jb25maWcvbWFzdGVyLmNmZzoKKyAg ICAgICAgKFJ1blB5dGhvblRlc3RzLnN0YXJ0KToKKwogMjAxMi0wOS0yNCAgWmFuIERvYmVyc2Vr ICA8emFuZG9iZXJzZWtAZ21haWwuY29tPgogCiAgICAgICAgIFJFR1JFU1NJT04gKHIxMjkyMTEt cjEyOTIxOCk6IGh0dHAvdGVzdHMvbG9hZGluZy9yZWRpcmVjdC13aXRoLW5vLWxvY2F0aW9uLWNy YXNoLmh0bWwgZmFpbGluZyBvbiBHVEsgTGludXggNjQtYml0IFJlbGVhc2UgV0syIChUZXN0cykK SW5kZXg6IFRvb2xzL0J1aWxkU2xhdmVTdXBwb3J0L2J1aWxkLndlYmtpdC5vcmctY29uZmlnL21h c3Rlci5jZmcKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PQotLS0gVG9vbHMvQnVpbGRTbGF2ZVN1cHBvcnQvYnVpbGQud2Vi a2l0Lm9yZy1jb25maWcvbWFzdGVyLmNmZwkocmV2aXNpb24gMTI5Mzg3KQorKysgVG9vbHMvQnVp bGRTbGF2ZVN1cHBvcnQvYnVpbGQud2Via2l0Lm9yZy1jb25maWcvbWFzdGVyLmNmZwkod29ya2lu ZyBjb3B5KQpAQCAtNDcwLDYgKzQ3MCwxMCBAQCBjbGFzcyBSdW5QeXRob25UZXN0cyhUZXN0V2l0 aEZhaWx1cmVDb3VuCiAgICAgICAgICMgaGVscHMgYW5kIGRvZXMgbm90IHNpZ25pZmljYW50bHkg cHJvbG9uZyB0aGUgY3ljbGUgdGltZS4KICAgICAgICAgaWYgcGxhdGZvcm0gPT0gJ2d0ayc6CiAg ICAgICAgICAgICBzZWxmLnNldENvbW1hbmQoc2VsZi5jb21tYW5kICsgWyctLWNoaWxkLXByb2Nl c3NlcycsICcxJ10pCisgICAgICAgICMgUHl0aG9uIHRlc3RzIGZhaWwgb24gd2luZG93cyBib3Rz IHdoZW4gcnVubmluZyBtb3JlIHRoYW4gb25lIGNoaWxkIHByb2Nlc3MKKyAgICAgICAgIyBodHRw czovL2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9OTc0NjUKKyAgICAgICAgaWYgcGxh dGZvcm0gPT0gJ3dpbic6CisgICAgICAgICAgICBzZWxmLnNldENvbW1hbmQoc2VsZi5jb21tYW5k ICsgWyctLWNoaWxkLXByb2Nlc3NlcycsICcxJ10pCiAgICAgICAgIHJldHVybiBzaGVsbC5UZXN0 LnN0YXJ0KHNlbGYpCiAKICAgICBkZWYgY291bnRGYWlsdXJlcyhzZWxmLCBjbWQpOgo=