run-pert-tests should have a --test-runner-count option

• Component: Tools / Tests
• Status: RESOLVED FIXED

[Glenn Adams]

Given the recent addition of process_run_count argument to PerfTest(), which controls the number of samples taken when performing an individual test in a test set, the value of this argument should be exposed as a command line option, e.g., --sampleCount.

Note that this is different from the --repeat argument proposed in bug 100030, which controls the number of times the entire test set is run. In particular, the number of samples (controlled by process_run_count) determine the number of data points used in statistical analysis; while different --repeat runs are not aggregated for statistical analysis in the shown results, i.e., are treated as distinct statistical result sets.

[Ryosuke Niwa]

Let's stick to the same terminology: process run count.

[Glenn Adams]

(In reply to comment #1)
> Let's stick to the same terminology: process run count.

thanks, we agreed on IRC to change this to test-runner-count (test_runner_count), for option and argument names, since this corresponds to the number of test runner (DRT/WTR) instances invoked (in serial execution - not parallel)

[Glenn Adams]

Created attachment 192128 [details]
Patch

[WebKit Review Bot]

Comment on attachment 192128 [details]
Patch

Clearing flags on attachment: 192128

Committed r145173: <http://trac.webkit.org/changeset/145173>

[WebKit Review Bot]

All reviewed patches have been landed.  Closing bug.