Bug 167867 - Beef up the ARES-6 explainer text
Summary: Beef up the ARES-6 explainer text
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: All All
: P2 Normal
Assignee: Filip Pizlo
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-02-05 21:28 PST by Filip Pizlo
Modified: 2017-02-10 11:51 PST (History)
7 users (show)

See Also:


Attachments
the patch (5.26 KB, patch)
2017-02-05 21:29 PST, Filip Pizlo
no flags Details | Formatted Diff | Diff
the patch (5.20 KB, patch)
2017-02-05 21:31 PST, Filip Pizlo
no flags Details | Formatted Diff | Diff
more (5.45 KB, patch)
2017-02-06 10:25 PST, Filip Pizlo
saam: review+
Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Filip Pizlo 2017-02-05 21:28:14 PST
Patch forthcoming.
Comment 1 Filip Pizlo 2017-02-05 21:29:07 PST
Created attachment 300684 [details]
the patch
Comment 2 Filip Pizlo 2017-02-05 21:31:26 PST
Created attachment 300685 [details]
the patch
Comment 3 Filip Pizlo 2017-02-06 10:25:45 PST
Created attachment 300734 [details]
more
Comment 4 Saam Barati 2017-02-06 11:17:17 PST
Comment on attachment 300734 [details]
more

View in context: https://bugs.webkit.org/attachment.cgi?id=300734&action=review

r=me

> PerformanceTests/ARES-6/index.html:111
> +        <p>ARES-6 rewards browsers that start up quickly and run smoothly. It's not enough to just measure the total running time of a workload. Browsers may perform differently for the same workload depending on how many times it has run. Garbage collection runs periodically, making some iterations take longer than others. Code that runs repeatedly gets optimized by the browser, so the first iteration of any workload is more expensive than the rest. ARES-6 runs these benchmarks for 200 iterations and reports the execution time of the first iteration, the average of the worst 2% iterations, and the overall average. Each of these values is given an equal weight when computing the ovarall time. ARES-6 equally rewards fast start-up, low jank, and sophisticated adaptive optimizations for long-running code.</p>

Maybe it's worth mentioning here that "the overall time" is the geomean of those three metrics?
Comment 5 Filip Pizlo 2017-02-06 14:03:53 PST
(In reply to comment #4)
> Comment on attachment 300734 [details]
> more
> 
> View in context:
> https://bugs.webkit.org/attachment.cgi?id=300734&action=review
> 
> r=me
> 
> > PerformanceTests/ARES-6/index.html:111
> > +        <p>ARES-6 rewards browsers that start up quickly and run smoothly. It's not enough to just measure the total running time of a workload. Browsers may perform differently for the same workload depending on how many times it has run. Garbage collection runs periodically, making some iterations take longer than others. Code that runs repeatedly gets optimized by the browser, so the first iteration of any workload is more expensive than the rest. ARES-6 runs these benchmarks for 200 iterations and reports the execution time of the first iteration, the average of the worst 2% iterations, and the overall average. Each of these values is given an equal weight when computing the ovarall time. ARES-6 equally rewards fast start-up, low jank, and sophisticated adaptive optimizations for long-running code.</p>
> 
> Maybe it's worth mentioning here that "the overall time" is the geomean of
> those three metrics?

I changed "overall average" to say "overall geometric mean".
Comment 6 Filip Pizlo 2017-02-10 11:51:53 PST
Landed in https://trac.webkit.org/changeset/212129