RESOLVED FIXED 29220
run-webkit-tests needs a --repeat-each=N option (AAABBBCCC instead of ABCABCABC)
https://bugs.webkit.org/show_bug.cgi?id=29220
Summary run-webkit-tests needs a --repeat-each=N option (AAABBBCCC instead of ABCABCABC)
Eric Seidel (no email)
Reported 2009-09-11 19:02:25 PDT
run-webkit-tests needs a --repeat-each=N option which will repeat each test N times. so: run-webkit-tests foo.html bar.html --repeat-each=N would do: foo -> passed foo -> passed bar -> passed bar -> passed This is useful for finding flakey tests (like https://bugs.webkit.org/show_bug.cgi?id=28845#c35) or tests which are causing later tests to fail. It also could be useful for finding tests which fail if their resources are already cached, etc.
Attachments
Patch v1 (2.81 KB, patch)
2009-09-22 13:56 PDT, Eric Seidel (no email)
darin: review+
Alexey Proskuryakov
Comment 1 2009-09-15 10:46:39 PDT
*** This bug has been marked as a duplicate of bug 29263 ***
Simon Fraser (smfr)
Comment 2 2009-09-15 10:51:15 PDT
Actually in 29263 I took the easy way out and just duplicated the @tests array N times, so that the order will be: ABCABCABC not AAABBBCCC I'd be fine either way.
Eric Seidel (no email)
Comment 3 2009-09-15 11:03:17 PDT
After discussion in bug 29263, unduping... bug 29263 added support for running tests ABC as ABCABCABC this bug is about running test ABC as AAABBBCCC
Eric Seidel (no email)
Comment 4 2009-09-22 13:56:52 PDT
Created attachment 39941 [details] Patch v1
Darin Adler
Comment 5 2009-09-22 14:07:21 PDT
Comment on attachment 39941 [details] Patch v1 > - --iterations n Number of times to run the tests > + --iterations n Number of times to run the set of tests (e.g. ABCABCABC) > + --repeat-each n Number of times to run each test (e.g. AAABBBCCC) These are alphabetical, so --repeat-each should go further down in the list.
Eric Seidel (no email)
Comment 6 2009-09-22 14:11:40 PDT
Eric Seidel (no email)
Comment 7 2009-09-22 14:11:44 PDT
Comment on attachment 39941 [details] Patch v1 Thanks! Fixed.
Eric Seidel (no email)
Comment 8 2009-09-22 15:39:49 PDT
Note You need to log in before you can comment on or make changes to this bug.