29220 2009-09-11 19:02:25 -0700 run-webkit-tests needs a --repeat-each=N option (AAABBBCCC instead of ABCABCABC) 2009-09-22 15:39:49 -0700 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) PC OS X 10.5 RESOLVED FIXED P2 Normal --- 1 eric webkit-unassigned simon.fraser oldest_to_newest 146868 0 eric 2009-09-11 19:02:25 -0700 run-webkit-tests needs a --repeat-each=N option which will repeat each test N times. so: run-webkit-tests foo.html bar.html --repeat-each=N would do: foo -> passed foo -> passed bar -> passed bar -> passed This is useful for finding flakey tests (like https://bugs.webkit.org/show_bug.cgi?id=28845#c35) or tests which are causing later tests to fail. It also could be useful for finding tests which fail if their resources are already cached, etc. 147324 1 ap 2009-09-15 10:46:39 -0700 *** This bug has been marked as a duplicate of bug 29263 *** 147328 2 simon.fraser 2009-09-15 10:51:15 -0700 Actually in 29263 I took the easy way out and just duplicated the @tests array N times, so that the order will be: ABCABCABC not AAABBBCCC I'd be fine either way. 147339 3 eric 2009-09-15 11:03:17 -0700 After discussion in bug 29263, unduping... bug 29263 added support for running tests ABC as ABCABCABC this bug is about running test ABC as AAABBBCCC 149172 4 39941 eric 2009-09-22 13:56:52 -0700 Created attachment 39941 Patch v1 149174 5 39941 darin 2009-09-22 14:07:21 -0700 Comment on attachment 39941 Patch v1 > - --iterations n Number of times to run the tests > + --iterations n Number of times to run the set of tests (e.g. ABCABCABC) > + --repeat-each n Number of times to run each test (e.g. AAABBBCCC) These are alphabetical, so --repeat-each should go further down in the list. 149178 6 eric 2009-09-22 14:11:40 -0700 Committed r48649: <http://trac.webkit.org/changeset/48649> 149179 7 39941 eric 2009-09-22 14:11:44 -0700 Comment on attachment 39941 Patch v1 Thanks! Fixed. 149234 8 eric 2009-09-22 15:39:49 -0700 Committed r48655: <http://trac.webkit.org/changeset/48655> 39941 2009-09-22 13:56:52 -0700 2009-09-22 14:11:44 -0700 Patch v1 bug-29220-20090922135650.patch text/plain 2873 eric ZGlmZiAtLWdpdCBhL1dlYktpdFRvb2xzL0NoYW5nZUxvZyBiL1dlYktpdFRvb2xzL0NoYW5nZUxv ZwppbmRleCBlNTFlNzBiLi44ZTZjOWMxIDEwMDY0NAotLS0gYS9XZWJLaXRUb29scy9DaGFuZ2VM b2cKKysrIGIvV2ViS2l0VG9vbHMvQ2hhbmdlTG9nCkBAIC0xLDMgKzEsMTIgQEAKKzIwMDktMDkt MjIgIEVyaWMgU2VpZGVsICA8ZXJpY0B3ZWJraXQub3JnPgorCisgICAgICAgIFJldmlld2VkIGJ5 IE5PQk9EWSAoT09QUyEpLgorCisgICAgICAgIHJ1bi13ZWJraXQtdGVzdHMgbmVlZHMgYSAtLXJl cGVhdC1lYWNoPU4gb3B0aW9uIChBQUFCQkJDQ0MgaW5zdGVhZCBvZiBBQkNBQkNBQkMpCisgICAg ICAgIGh0dHBzOi8vYnVncy53ZWJraXQub3JnL3Nob3dfYnVnLmNnaT9pZD0yOTIyMAorCisgICAg ICAgICogU2NyaXB0cy9ydW4td2Via2l0LXRlc3RzOgorCiAyMDA5LTA5LTIxICBFcmljIFNlaWRl bCAgPGVyaWNAd2Via2l0Lm9yZz4KIAogICAgICAgICBSZXZpZXdlZCBieSBOT0JPRFkgKE9PUFMh KS4KZGlmZiAtLWdpdCBhL1dlYktpdFRvb2xzL1NjcmlwdHMvcnVuLXdlYmtpdC10ZXN0cyBiL1dl YktpdFRvb2xzL1NjcmlwdHMvcnVuLXdlYmtpdC10ZXN0cwppbmRleCA4NmYxYjExLi41NGYxY2U0 IDEwMDc1NQotLS0gYS9XZWJLaXRUb29scy9TY3JpcHRzL3J1bi13ZWJraXQtdGVzdHMKKysrIGIv V2ViS2l0VG9vbHMvU2NyaXB0cy9ydW4td2Via2l0LXRlc3RzCkBAIC0xMjUsNiArMTI1LDcgQEAg bXkgJHBpeGVsVGVzdHMgPSAnJzsKIG15ICRwbGF0Zm9ybTsKIG15ICRxdWlldCA9ICcnOwogbXkg JHJhbmRvbWl6ZVRlc3RzID0gMDsKK215ICRyZXBlYXRFYWNoID0gMTsKIG15ICRyZXBvcnQxMFNs b3dlc3QgPSAwOwogbXkgJHJlc2V0UmVzdWx0cyA9IDA7CiBteSAkcmV2ZXJzZVRlc3RzID0gMDsK QEAgLTIxMCw3ICsyMTEsOCBAQCBVc2FnZTogJHByb2dyYW1OYW1lIFtvcHRpb25zXSBbdGVzdGRp cnx0ZXN0cGF0aCAuLi5dCiAgIC1ofC0taGVscCAgICAgICAgICAgICAgICAgICAgICAgU2hvdyB0 aGlzIGhlbHAgbWVzc2FnZQogICAtLVtuby1daHR0cCAgICAgICAgICAgICAgICAgICAgIFJ1biAo b3IgZG8gbm90IHJ1bikgaHR0cCB0ZXN0cyAoZGVmYXVsdDogJGh0dHBEZWZhdWx0KQogICAtaXwt LWlnbm9yZS10ZXN0cyAgICAgICAgICAgICAgIENvbW1hLXNlcGFyYXRlZCBsaXN0IG9mIGRpcmVj dG9yaWVzIG9yIHRlc3RzIHRvIGlnbm9yZQotICAtLWl0ZXJhdGlvbnMgbiAgICAgICAgICAgICAg ICAgIE51bWJlciBvZiB0aW1lcyB0byBydW4gdGhlIHRlc3RzCisgIC0taXRlcmF0aW9ucyBuICAg ICAgICAgICAgICAgICAgTnVtYmVyIG9mIHRpbWVzIHRvIHJ1biB0aGUgc2V0IG9mIHRlc3RzIChl LmcuIEFCQ0FCQ0FCQykKKyAgLS1yZXBlYXQtZWFjaCBuICAgICAgICAgICAgICAgICBOdW1iZXIg b2YgdGltZXMgdG8gcnVuIGVhY2ggdGVzdCAoZS5nLiBBQUFCQkJDQ0MpCiAgIC0tW25vLV1sYXVu Y2gtc2FmYXJpICAgICAgICAgICAgTGF1bmNoIChvciBkbyBub3QgbGF1bmNoKSBTYWZhcmkgdG8g ZGlzcGxheSB0ZXN0IHJlc3VsdHMgKGRlZmF1bHQ6ICRsYXVuY2hTYWZhcmlEZWZhdWx0KQogICAt bHwtLWxlYWtzICAgICAgICAgICAgICAgICAgICAgIEVuYWJsZSBsZWFrcyBjaGVja2luZwogICAt LVtuby1dbmV3LXRlc3QtcmVzdWx0cyAgICAgICAgIEdlbmVyYXRlIHJlc3VsdHMgZm9yIG5ldyB0 ZXN0cwpAQCAtMjY0LDYgKzI2Niw3IEBAIG15ICRnZXRPcHRpb25zUmVzdWx0ID0gR2V0T3B0aW9u cygKICAgICAncG9ydD1pJyA9PiBcJGh0dHBkUG9ydCwKICAgICAncXVpZXR8cScgPT4gXCRxdWll dCwKICAgICAncmFuZG9tJyA9PiBcJHJhbmRvbWl6ZVRlc3RzLAorICAgICdyZXBlYXQtZWFjaD1p JyA9PiBcJHJlcGVhdEVhY2gsCiAgICAgJ3Jlc2V0LXJlc3VsdHMnID0+IFwkcmVzZXRSZXN1bHRz LAogICAgICdyZXN1bHRzLWRpcmVjdG9yeXxvPXMnID0+IFwkdGVzdFJlc3VsdHNEaXJlY3Rvcnks CiAgICAgJ3JldmVyc2UnID0+IFwkcmV2ZXJzZVRlc3RzLApAQCAtNDg2LDEzICs0ODksMjYgQEAg bXkgJGlzSHR0cGRPcGVuID0gMDsKIHN1YiBjYXRjaF9waXBlIHsgJGR1bXBUb29sQ3Jhc2hlZCA9 IDE7IH0KICRTSUd7IlBJUEUifSA9ICJjYXRjaF9waXBlIjsKIAotcHJpbnQgIlRlc3RpbmcgIiwg c2NhbGFyIEB0ZXN0cywgIiB0ZXN0IGNhc2VzIiwgKCRpdGVyYXRpb25zID4gMSkgPyAiICRpdGVy YXRpb25zIHRpbWVzLlxuIiA6ICIuXG4iOworcHJpbnQgIlRlc3RpbmcgIiwgc2NhbGFyIEB0ZXN0 cywgIiB0ZXN0IGNhc2VzIjsKK3ByaW50ICIkaXRlcmF0aW9ucyB0aW1lcyIgaWYgKCRpdGVyYXRp b25zID4gMSk7CitwcmludCAiLCByZXBlYXRpbmcgZWFjaCB0ZXN0ICRyZXBlYXRFYWNoIHRpbWVz IiBpZiAoJHJlcGVhdEVhY2ggPiAxKTsKK3ByaW50ICIuXG4iOworCiBteSAkb3ZlcmFsbFN0YXJ0 VGltZSA9IHRpbWU7CiAKIG15ICVleHBlY3RlZFJlc3VsdFBhdGhzOwogCi0jIEFkZCBpdGVyYXRp b25zCiBteSBAb3JpZ2luYWxUZXN0cyA9IEB0ZXN0czsKKyMgQWRkIGluZGl2aWR1YWwgdGVzdCBy ZXBldGl0aW9ucworaWYgKCRyZXBlYXRFYWNoID4gMSkgeworICAgIEB0ZXN0cyA9ICgpOworICAg IGZvcmVhY2ggbXkgJHRlc3QgKEBvcmlnaW5hbFRlc3RzKSB7CisgICAgICAgIGZvciAobXkgJGkg PSAwOyAkaSA8ICRyZXBlYXRFYWNoOyAkaSsrKSB7CisgICAgICAgICAgICBwdXNoKEB0ZXN0cywg JHRlc3QpOworICAgICAgICB9CisgICAgfQorfQorIyBBZGQgdGVzdCBzZXQgcmVwZXRpdGlvbnMK IGZvciAobXkgJGkgPSAxOyAkaSA8ICRpdGVyYXRpb25zOyAkaSsrKSB7CiAgICAgcHVzaChAdGVz dHMsIEBvcmlnaW5hbFRlc3RzKTsKIH0=