Bug 154673

Summary: Update animation benchmark and tests
Product: WebKit Reporter: Jon Lee <jonlee>
Component: WebCore Misc.Assignee: Jon Lee <jonlee>
Status: RESOLVED FIXED    
Severity: Normal CC: cdumez, commit-queue, dino, rniwa, sabouhallawa, simon.fraser
Priority: P2    
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
1. Fix the cursor in the graph analysis when the min complexity is not 0
none
2. Consolidate JS files, and move statistics out to a separate JS.
none
3. Teach the harness to evaluate the samples and determine the test score.
none
4. Allow dropping results JSON.
none
5. Fix graph drawing.
none
6. Use bootstrapping to get confidence interval in the breakpoint.
none
7. Switch to a pseudo-random number generator.
none
8. Update test harness reporting.
none
9. Add meta charset so that encodings between harness and test match.
none
10. Have the bootstrap calculation occur between tests. Clean up harness.
none
11. Update the ramp controller.
none
12. Tests: update multiply test
none
13. Tests: Update distance metric so that fringe tiles get more color.
none
14. Tests: update visuals.
none
Merged patch sans Tests changes
dino: review+
Merged patch of only Tests changes dino: review+

Jon Lee
Reported 2016-02-25 02:09:45 PST
Refine the ramp controller, and use bootstrapping to calculate confidence intervals.
Attachments
1. Fix the cursor in the graph analysis when the min complexity is not 0 (3.19 KB, patch)
2016-02-25 02:11 PST, Jon Lee
no flags
2. Consolidate JS files, and move statistics out to a separate JS. (40.80 KB, patch)
2016-02-25 02:11 PST, Jon Lee
no flags
3. Teach the harness to evaluate the samples and determine the test score. (77.45 KB, patch)
2016-02-25 02:11 PST, Jon Lee
no flags
4. Allow dropping results JSON. (5.24 KB, patch)
2016-02-25 02:12 PST, Jon Lee
no flags
5. Fix graph drawing. (4.87 KB, patch)
2016-02-25 02:12 PST, Jon Lee
no flags
6. Use bootstrapping to get confidence interval in the breakpoint. (26.43 KB, patch)
2016-02-25 02:12 PST, Jon Lee
no flags
7. Switch to a pseudo-random number generator. (10.67 KB, patch)
2016-02-25 02:13 PST, Jon Lee
no flags
8. Update test harness reporting. (8.49 KB, patch)
2016-02-25 02:13 PST, Jon Lee
no flags
9. Add meta charset so that encodings between harness and test match. (14.52 KB, patch)
2016-02-25 02:13 PST, Jon Lee
no flags
10. Have the bootstrap calculation occur between tests. Clean up harness. (14.31 KB, patch)
2016-02-25 02:14 PST, Jon Lee
no flags
11. Update the ramp controller. (24.33 KB, patch)
2016-02-25 02:17 PST, Jon Lee
no flags
12. Tests: update multiply test (3.65 KB, patch)
2016-02-25 02:18 PST, Jon Lee
no flags
13. Tests: Update distance metric so that fringe tiles get more color. (1.73 KB, patch)
2016-02-25 02:18 PST, Jon Lee
no flags
14. Tests: update visuals. (6.56 KB, patch)
2016-02-25 02:18 PST, Jon Lee
no flags
Merged patch sans Tests changes (182.10 KB, patch)
2016-02-25 02:22 PST, Jon Lee
dino: review+
Merged patch of only Tests changes (9.97 KB, patch)
2016-02-25 02:25 PST, Jon Lee
dino: review+
Jon Lee
Comment 1 2016-02-25 02:11:01 PST
Created attachment 272183 [details] 1. Fix the cursor in the graph analysis when the min complexity is not 0
Jon Lee
Comment 2 2016-02-25 02:11:24 PST
Created attachment 272184 [details] 2. Consolidate JS files, and move statistics out to a separate JS.
Jon Lee
Comment 3 2016-02-25 02:11:57 PST
Created attachment 272185 [details] 3. Teach the harness to evaluate the samples and determine the test score.
Jon Lee
Comment 4 2016-02-25 02:12:20 PST
Created attachment 272186 [details] 4. Allow dropping results JSON.
Jon Lee
Comment 5 2016-02-25 02:12:35 PST
Created attachment 272187 [details] 5. Fix graph drawing.
Jon Lee
Comment 6 2016-02-25 02:12:51 PST
Created attachment 272188 [details] 6. Use bootstrapping to get confidence interval in the breakpoint.
Jon Lee
Comment 7 2016-02-25 02:13:14 PST
Created attachment 272189 [details] 7. Switch to a pseudo-random number generator.
Jon Lee
Comment 8 2016-02-25 02:13:32 PST
Created attachment 272190 [details] 8. Update test harness reporting.
Jon Lee
Comment 9 2016-02-25 02:13:49 PST
Created attachment 272191 [details] 9. Add meta charset so that encodings between harness and test match.
Jon Lee
Comment 10 2016-02-25 02:14:11 PST
Created attachment 272192 [details] 10. Have the bootstrap calculation occur between tests. Clean up harness.
Jon Lee
Comment 11 2016-02-25 02:17:42 PST
Created attachment 272193 [details] 11. Update the ramp controller.
Jon Lee
Comment 12 2016-02-25 02:18:01 PST
Created attachment 272194 [details] 12. Tests: update multiply test
Jon Lee
Comment 13 2016-02-25 02:18:16 PST
Created attachment 272195 [details] 13. Tests: Update distance metric so that fringe tiles get more color.
Jon Lee
Comment 14 2016-02-25 02:18:39 PST
Created attachment 272196 [details] 14. Tests: update visuals.
Jon Lee
Comment 15 2016-02-25 02:22:49 PST
Created attachment 272197 [details] Merged patch sans Tests changes
Jon Lee
Comment 16 2016-02-25 02:25:34 PST
Created attachment 272198 [details] Merged patch of only Tests changes
Dean Jackson
Comment 17 2016-02-26 13:38:39 PST
Comment on attachment 272197 [details] Merged patch sans Tests changes View in context: https://bugs.webkit.org/attachment.cgi?id=272197&action=review Giving this a provisional r+ assuming Said will do an informal review. I'm not going to pretend I understood everything :) > PerformanceTests/Animometer/resources/debug-runner/animometer.js:31 > + button.textContent = Strings.text.graph + "..."; Typographic nerds would prefer "…" :) > PerformanceTests/Animometer/resources/debug-runner/animometer.js:500 > + if (dashboard.options["adjustment"] == "ramp") { > + Headers.details[3].disabled = true; > + } else { Nit: Single line conditional > PerformanceTests/Animometer/resources/debug-runner/graph.js:9 > + element.testResult = testResult; > + element.testData = testData; More of a general comment, but I wonder if we should prefix these custom attrs/properties with _ > PerformanceTests/Animometer/resources/debug-runner/graph.js:595 > + document.getElementById("complexity-regression-aggregate-raw").textContent = complexityRegression.complexity.toFixed(2) + ", ±" + complexityRegression.stdev.toFixed(2) + "ms"; I guess this is just a review tool bug - supposed to be the +/- sign? > PerformanceTests/Animometer/resources/debug-runner/graph.js:603 > + "â", Same here, but not sure what it is supposed to be. > PerformanceTests/Animometer/resources/extensions.js:467 > + for (var i = 0; i < this._size; ++i) { > + out += this._values[i]; > + if (i < this._size - 1) > + out += ", "; > + } Can you use this._values.join(", ") here? $ jsc >>> [1, 2, 3, 4, 5].join(", ") 1, 2, 3, 4, 5
Jon Lee
Comment 18 2016-02-26 14:05:28 PST
Comment on attachment 272197 [details] Merged patch sans Tests changes View in context: https://bugs.webkit.org/attachment.cgi?id=272197&action=review >> PerformanceTests/Animometer/resources/debug-runner/animometer.js:31 >> + button.textContent = Strings.text.graph + "..."; > > Typographic nerds would prefer "…" :) Done. >> PerformanceTests/Animometer/resources/debug-runner/animometer.js:500 >> + } else { > > Nit: Single line conditional Done. >> PerformanceTests/Animometer/resources/debug-runner/graph.js:9 >> + element.testData = testData; > > More of a general comment, but I wonder if we should prefix these custom attrs/properties with _ We could. Done. >> PerformanceTests/Animometer/resources/debug-runner/graph.js:595 >> + document.getElementById("complexity-regression-aggregate-raw").textContent = complexityRegression.complexity.toFixed(2) + ", ±" + complexityRegression.stdev.toFixed(2) + "ms"; > > I guess this is just a review tool bug - supposed to be the +/- sign? Yes, it is. >> PerformanceTests/Animometer/resources/debug-runner/graph.js:603 >> + "â", > > Same here, but not sure what it is supposed to be. en dash. >> PerformanceTests/Animometer/resources/extensions.js:467 >> + } > > Can you use this._values.join(", ") here? > > $ jsc I didn't touch this code; I was just moving it, but yes we could do that.
Jon Lee
Comment 19 2016-02-26 20:32:14 PST
Jon Lee
Comment 20 2016-02-26 20:33:30 PST
Jon Lee
Comment 21 2016-02-26 20:44:18 PST
follow-up with Dean's comments Committed r197232: <http://trac.webkit.org/changeset/197232>
Note You need to log in before you can comment on or make changes to this bug.