RESOLVED FIXED 187829
Make JetStream 2
https://bugs.webkit.org/show_bug.cgi?id=187829
Summary Make JetStream 2
Saam Barati
Reported 2018-07-19 16:53:18 PDT
Goals: - measure start up, worst case, and peak perf - measure newer JS features - measure Wasm - measure Promise perf Ideas: - most tests from JetStream 1 - replace some asm.js tests with Wasm tests - include all of ARES-6 - worker bomb test - WSL test - kraken, maybe, if license issue works out - include RexBench - include ToolingBench (or some parts of it) - some code load test that uses newer source code that includes ES6+ language features - use {1st iteration, worst 4, average time} style of measuring iterations like ARES-6 on all subtests (or most, we need to figure out what that means on SunSpider subtests) - one subtest should simply be measure of total running time of benchmark. So if you hide demons in between benchmark runs, you'll be penalized by at least one subtest (we could even weight this more than just 1 test too)
Attachments
WIP (26.01 MB, patch)
2018-07-19 16:54 PDT, Saam Barati
no flags
WIP (56.92 MB, patch)
2018-07-20 17:30 PDT, Saam Barati
no flags
WIP (56.92 MB, patch)
2018-07-26 13:53 PDT, Saam Barati
no flags
WIP (57.58 MB, patch)
2018-07-27 15:55 PDT, Saam Barati
no flags
WIP (57.58 MB, patch)
2018-07-27 18:07 PDT, Saam Barati
no flags
WIP (57.58 MB, patch)
2018-07-29 14:55 PDT, Saam Barati
no flags
WIP (57.69 MB, patch)
2018-07-30 18:17 PDT, Saam Barati
no flags
WIP (57.69 MB, patch)
2018-07-30 18:50 PDT, Saam Barati
no flags
WIP (57.94 MB, patch)
2018-07-31 18:04 PDT, Saam Barati
no flags
WIP (57.94 MB, patch)
2018-07-31 18:34 PDT, Saam Barati
no flags
WIP (58.77 MB, patch)
2018-08-01 15:43 PDT, Saam Barati
no flags
WIP (58.77 MB, patch)
2018-08-01 17:24 PDT, Saam Barati
no flags
WIP (59.26 MB, patch)
2018-08-01 19:06 PDT, Saam Barati
no flags
WIP (59.26 MB, patch)
2018-08-02 17:22 PDT, Saam Barati
no flags
WIP (66.25 MB, patch)
2018-08-02 21:11 PDT, Saam Barati
no flags
WIP (69.18 MB, patch)
2018-08-06 13:37 PDT, Saam Barati
no flags
WIP (70.01 MB, patch)
2018-08-06 18:19 PDT, Saam Barati
no flags
WIP (70.01 MB, patch)
2018-08-06 18:26 PDT, Saam Barati
no flags
WIP (70.08 MB, patch)
2018-08-06 20:48 PDT, Saam Barati
no flags
WIP (70.16 MB, patch)
2018-08-07 14:11 PDT, Saam Barati
no flags
WIP (70.16 MB, patch)
2018-08-07 14:13 PDT, Saam Barati
no flags
WIP (72.18 MB, patch)
2018-08-10 19:29 PDT, Saam Barati
no flags
WIP (72.19 MB, patch)
2018-08-13 16:39 PDT, Saam Barati
no flags
WIP (72.19 MB, patch)
2018-08-13 17:41 PDT, Saam Barati
no flags
WIP (72.19 MB, patch)
2018-08-13 17:46 PDT, Saam Barati
no flags
WIP (72.19 MB, patch)
2018-08-21 19:16 PDT, Saam Barati
no flags
WIP (72.19 MB, patch)
2018-08-22 15:36 PDT, Saam Barati
no flags
WIP (72.19 MB, patch)
2018-08-22 19:59 PDT, Saam Barati
no flags
WIP (72.19 MB, patch)
2018-08-22 22:17 PDT, Saam Barati
no flags
WIP (72.68 MB, patch)
2018-08-23 22:29 PDT, Saam Barati
no flags
WIP (72.58 MB, patch)
2018-08-24 17:29 PDT, Saam Barati
no flags
WIP (72.58 MB, patch)
2018-08-27 11:17 PDT, Saam Barati
no flags
WIP (72.59 MB, patch)
2018-08-27 16:13 PDT, Saam Barati
no flags
WIP (65.10 MB, patch)
2018-08-28 18:20 PDT, Saam Barati
no flags
WIP (65.10 MB, patch)
2018-08-28 20:38 PDT, Saam Barati
no flags
WIP (65.10 MB, patch)
2018-08-28 23:32 PDT, Saam Barati
no flags
WIP (65.10 MB, patch)
2018-08-29 18:50 PDT, Saam Barati
no flags
WIP (65.16 MB, patch)
2018-08-30 13:19 PDT, Saam Barati
no flags
WIP (65.03 MB, patch)
2018-08-30 16:31 PDT, Saam Barati
no flags
WIP (65.03 MB, patch)
2018-08-30 17:54 PDT, Saam Barati
no flags
WIP (209.02 MB, patch)
2018-10-15 11:45 PDT, Saam Barati
no flags
Saam Barati
Comment 1 2018-07-19 16:54:33 PDT
Saam Barati
Comment 2 2018-07-20 17:30:04 PDT
Saam Barati
Comment 3 2018-07-26 13:53:23 PDT
Saam Barati
Comment 4 2018-07-27 15:55:50 PDT
Saam Barati
Comment 5 2018-07-27 18:07:08 PDT
Saam Barati
Comment 6 2018-07-29 14:55:30 PDT
Saam Barati
Comment 7 2018-07-30 18:17:30 PDT
Saam Barati
Comment 8 2018-07-30 18:50:19 PDT
Saam Barati
Comment 9 2018-07-31 18:04:51 PDT
Created attachment 346240 [details] WIP Currently the benchmark is using a crazy amount of memory. Need to figure out what's going on.
Saam Barati
Comment 10 2018-07-31 18:34:12 PDT
Saam Barati
Comment 11 2018-08-01 15:43:06 PDT
Created attachment 346307 [details] WIP add bomb-workers
Saam Barati
Comment 12 2018-08-01 17:24:35 PDT
Saam Barati
Comment 13 2018-08-01 19:06:37 PDT
Created attachment 346352 [details] WIP starting to add some stanford crypto tests
Saam Barati
Comment 14 2018-08-02 17:22:17 PDT
Saam Barati
Comment 15 2018-08-02 21:11:06 PDT
Saam Barati
Comment 16 2018-08-06 13:37:07 PDT
Saam Barati
Comment 17 2018-08-06 18:19:43 PDT
Created attachment 346672 [details] WIP Mostly runs on the CLI now. Just web tooling bench doesn't. I need to figure that out.
Saam Barati
Comment 18 2018-08-06 18:26:48 PDT
Saam Barati
Comment 19 2018-08-06 20:48:50 PDT
Saam Barati
Comment 20 2018-08-07 14:11:59 PDT
Saam Barati
Comment 21 2018-08-07 14:13:42 PDT
Saam Barati
Comment 22 2018-08-10 19:29:52 PDT
Saam Barati
Comment 23 2018-08-13 16:39:07 PDT
Saam Barati
Comment 24 2018-08-13 17:41:43 PDT
Saam Barati
Comment 25 2018-08-13 17:46:44 PDT
Saam Barati
Comment 26 2018-08-21 19:16:55 PDT
Saam Barati
Comment 27 2018-08-22 15:36:51 PDT
Saam Barati
Comment 28 2018-08-22 19:59:49 PDT
Saam Barati
Comment 29 2018-08-22 22:17:11 PDT
Saam Barati
Comment 30 2018-08-23 22:29:50 PDT
Created attachment 347992 [details] WIP Added ai-astar. Also, completed the trifecta of code load tests; we're gonna have: 1. Octane code-first-load from JetStream1 2. multi-code-load inspector, where we actually load identical programs with some frequency. 3. first-code-load inspector, where we load unique programs each time.
Saam Barati
Comment 31 2018-08-24 17:29:59 PDT
Saam Barati
Comment 32 2018-08-27 11:17:23 PDT
Saam Barati
Comment 33 2018-08-27 16:13:51 PDT
Saam Barati
Comment 34 2018-08-28 18:20:34 PDT
Saam Barati
Comment 35 2018-08-28 20:38:12 PDT
Saam Barati
Comment 36 2018-08-28 23:32:10 PDT
Saam Barati
Comment 37 2018-08-29 18:50:25 PDT
Saam Barati
Comment 38 2018-08-30 13:19:34 PDT
Saam Barati
Comment 39 2018-08-30 16:31:33 PDT
Saam Barati
Comment 40 2018-08-30 17:54:22 PDT
Saam Barati
Comment 41 2018-10-15 11:45:35 PDT
Saam Barati
Comment 42 2018-10-18 13:33:55 PDT
Rubber stamped by Mark Lam.
Saam Barati
Comment 43 2018-10-18 14:12:12 PDT
Note You need to log in before you can comment on or make changes to this bug.