Bug 100037 - PerformanceTests/runner.js should limit output precision in relation to the stddev
Summary: PerformanceTests/runner.js should limit output precision in relation to the s...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks: 77037
  Show dependency tree / graph
 
Reported: 2012-10-22 15:00 PDT by Eric Seidel (no email)
Modified: 2012-11-19 10:27 PST (History)
3 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Eric Seidel (no email) 2012-10-22 15:00:13 PDT 
PerformanceTests/runner.js should limit output precision in relation to the stddev

e.g.

avg 95.18194456386033 runs/s
median 95.1814733027575 runs/s
stdev 0.22485624887911804 runs/s
min 94.7867298578199 runs/s
max 95.4653937947494 runs/s

It seems silly to output to 15 digits when the stddev says at best 4 of those are useful.

Maybe keying off the stddev is incorrect and we should just output only 4 digits anyway?