16849 2008-01-11 18:48:47 -0800 SunSpider should be rebased to run at least twice as long 2011-07-02 12:42:57 -0700 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) Mac OS X 10.4 NEW P2 Normal --- 1 eric webkit-unassigned darin mjs seth.gaurav oldest_to_newest 66996 0 eric 2008-01-11 18:48:47 -0800 SunSpider should be rebased to run at least twice as long SunSpider now runs in under 4 seconds on my (laptop) hardware. The test should be rebased to take at least twice that long to help reduce error rates. Yes, that means it would be *even slower* in other browsers, but my long term goal is to move all browsers to at least 10x their current JavaScript speed. Rebasing the test to take 2x as long is a step in that direction. 66997 1 eric 2008-01-11 18:49:50 -0800 Error rates is not the sole motivator. But certainly with more signal, small amounts of noise in the testing environment matter less. 67575 2 fishd 2008-01-17 22:43:19 -0800 Perhaps the tests should just be run multiple times, and then compute mean and variance? 67579 3 eric 2008-01-17 23:49:34 -0800 You can already do that with --runs=15 But that doesn't really address the precision question in my mind.