Bug 187829 - Make JetStream 2
Summary: Make JetStream 2
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: JavaScriptCore (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Saam Barati
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2018-07-19 16:53 PDT by Saam Barati
Modified: 2018-10-18 14:13 PDT (History)
19 users (show)

See Also:

Attachments
WIP (26.01 MB, patch)
2018-07-19 16:54 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (56.92 MB, patch)
2018-07-20 17:30 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (56.92 MB, patch)
2018-07-26 13:53 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (57.58 MB, patch)
2018-07-27 15:55 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (57.58 MB, patch)
2018-07-27 18:07 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (57.58 MB, patch)
2018-07-29 14:55 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (57.69 MB, patch)
2018-07-30 18:17 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (57.69 MB, patch)
2018-07-30 18:50 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (57.94 MB, patch)
2018-07-31 18:04 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (57.94 MB, patch)
2018-07-31 18:34 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (58.77 MB, patch)
2018-08-01 15:43 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (58.77 MB, patch)
2018-08-01 17:24 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (59.26 MB, patch)
2018-08-01 19:06 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (59.26 MB, patch)
2018-08-02 17:22 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (66.25 MB, patch)
2018-08-02 21:11 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (69.18 MB, patch)
2018-08-06 13:37 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (70.01 MB, patch)
2018-08-06 18:19 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (70.01 MB, patch)
2018-08-06 18:26 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (70.08 MB, patch)
2018-08-06 20:48 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (70.16 MB, patch)
2018-08-07 14:11 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (70.16 MB, patch)
2018-08-07 14:13 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (72.18 MB, patch)
2018-08-10 19:29 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (72.19 MB, patch)
2018-08-13 16:39 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (72.19 MB, patch)
2018-08-13 17:41 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (72.19 MB, patch)
2018-08-13 17:46 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (72.19 MB, patch)
2018-08-21 19:16 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (72.19 MB, patch)
2018-08-22 15:36 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (72.19 MB, patch)
2018-08-22 19:59 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (72.19 MB, patch)
2018-08-22 22:17 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (72.68 MB, patch)
2018-08-23 22:29 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (72.58 MB, patch)
2018-08-24 17:29 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (72.58 MB, patch)
2018-08-27 11:17 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (72.59 MB, patch)
2018-08-27 16:13 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (65.10 MB, patch)
2018-08-28 18:20 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (65.10 MB, patch)
2018-08-28 20:38 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (65.10 MB, patch)
2018-08-28 23:32 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (65.10 MB, patch)
2018-08-29 18:50 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (65.16 MB, patch)
2018-08-30 13:19 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (65.03 MB, patch)
2018-08-30 16:31 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (65.03 MB, patch)
2018-08-30 17:54 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
WIP (209.02 MB, patch)
2018-10-15 11:45 PDT, Saam Barati 		no flags Details | Formatted Diff | Diff
Show Obsolete (40) View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Saam Barati 2018-07-19 16:53:18 PDT 
Goals:

- measure start up, worst case, and peak perf
- measure newer JS features
- measure Wasm
- measure Promise perf

Ideas:
- most tests from JetStream 1
- replace some asm.js tests with Wasm tests
- include all of ARES-6
- worker bomb test
- WSL test
- kraken, maybe, if license issue works out
- include RexBench
- include ToolingBench (or some parts of it)
- some code load test that uses newer source code that includes ES6+ language features
- use {1st iteration, worst 4, average time} style of measuring iterations like ARES-6 on all subtests (or most, we need to figure out what that means on SunSpider subtests)
- one subtest should simply be measure of total running time of benchmark. So if you hide demons in between benchmark runs, you'll be penalized by at least one subtest (we could even weight this more than just 1 test too)
Comment 1 Saam Barati 2018-07-19 16:54:33 PDT 
Created attachment 345400 [details]
WIP
Comment 2 Saam Barati 2018-07-20 17:30:04 PDT 
Created attachment 345494 [details]
WIP
Comment 3 Saam Barati 2018-07-26 13:53:23 PDT 
Created attachment 345862 [details]
WIP
Comment 4 Saam Barati 2018-07-27 15:55:50 PDT 
Created attachment 345964 [details]
WIP
Comment 5 Saam Barati 2018-07-27 18:07:08 PDT 
Created attachment 345981 [details]
WIP
Comment 6 Saam Barati 2018-07-29 14:55:30 PDT 
Created attachment 346043 [details]
WIP
Comment 7 Saam Barati 2018-07-30 18:17:30 PDT 
Created attachment 346134 [details]
WIP
Comment 8 Saam Barati 2018-07-30 18:50:19 PDT 
Created attachment 346137 [details]
WIP
Comment 9 Saam Barati 2018-07-31 18:04:51 PDT 
Created attachment 346240 [details]
WIP

Currently the benchmark is using a crazy amount of memory. Need to figure out what's going on.
Comment 10 Saam Barati 2018-07-31 18:34:12 PDT 
Created attachment 346246 [details]
WIP
Comment 11 Saam Barati 2018-08-01 15:43:06 PDT 
Created attachment 346307 [details]
WIP

add bomb-workers
Comment 12 Saam Barati 2018-08-01 17:24:35 PDT 
Created attachment 346314 [details]
WIP
Comment 13 Saam Barati 2018-08-01 19:06:37 PDT 
Created attachment 346352 [details]
WIP

starting to add some stanford crypto tests
Comment 14 Saam Barati 2018-08-02 17:22:17 PDT 
Created attachment 346436 [details]
WIP
Comment 15 Saam Barati 2018-08-02 21:11:06 PDT 
Created attachment 346449 [details]
WIP
Comment 16 Saam Barati 2018-08-06 13:37:07 PDT 
Created attachment 346651 [details]
WIP
Comment 17 Saam Barati 2018-08-06 18:19:43 PDT 
Created attachment 346672 [details]
WIP

Mostly runs on the CLI now. Just web tooling bench doesn't. I need to figure that out.
Comment 18 Saam Barati 2018-08-06 18:26:48 PDT 
Created attachment 346674 [details]
WIP
Comment 19 Saam Barati 2018-08-06 20:48:50 PDT 
Created attachment 346681 [details]
WIP
Comment 20 Saam Barati 2018-08-07 14:11:59 PDT 
Created attachment 346732 [details]
WIP
Comment 21 Saam Barati 2018-08-07 14:13:42 PDT 
Created attachment 346733 [details]
WIP
Comment 22 Saam Barati 2018-08-10 19:29:52 PDT 
Created attachment 346952 [details]
WIP
Comment 23 Saam Barati 2018-08-13 16:39:07 PDT 
Created attachment 347053 [details]
WIP
Comment 24 Saam Barati 2018-08-13 17:41:43 PDT 
Created attachment 347057 [details]
WIP
Comment 25 Saam Barati 2018-08-13 17:46:44 PDT 
Created attachment 347058 [details]
WIP
Comment 26 Saam Barati 2018-08-21 19:16:55 PDT 
Created attachment 347752 [details]
WIP
Comment 27 Saam Barati 2018-08-22 15:36:51 PDT 
Created attachment 347856 [details]
WIP
Comment 28 Saam Barati 2018-08-22 19:59:49 PDT 
Created attachment 347897 [details]
WIP
Comment 29 Saam Barati 2018-08-22 22:17:11 PDT 
Created attachment 347899 [details]
WIP
Comment 30 Saam Barati 2018-08-23 22:29:50 PDT 
Created attachment 347992 [details]
WIP

Added ai-astar.

Also, completed the trifecta of code load tests; we're gonna have:
1. Octane code-first-load from JetStream1
2. multi-code-load inspector, where we actually load identical programs with some frequency.
3. first-code-load inspector, where we load unique programs each time.
Comment 31 Saam Barati 2018-08-24 17:29:59 PDT 
Created attachment 348061 [details]
WIP
Comment 32 Saam Barati 2018-08-27 11:17:23 PDT 
Created attachment 348170 [details]
WIP
Comment 33 Saam Barati 2018-08-27 16:13:51 PDT 
Created attachment 348231 [details]
WIP
Comment 34 Saam Barati 2018-08-28 18:20:34 PDT 
Created attachment 348372 [details]
WIP
Comment 35 Saam Barati 2018-08-28 20:38:12 PDT 
Created attachment 348385 [details]
WIP
Comment 36 Saam Barati 2018-08-28 23:32:10 PDT 
Created attachment 348394 [details]
WIP
Comment 37 Saam Barati 2018-08-29 18:50:25 PDT 
Created attachment 348461 [details]
WIP
Comment 38 Saam Barati 2018-08-30 13:19:34 PDT 
Created attachment 348535 [details]
WIP
Comment 39 Saam Barati 2018-08-30 16:31:33 PDT 
Created attachment 348564 [details]
WIP
Comment 40 Saam Barati 2018-08-30 17:54:22 PDT 
Created attachment 348576 [details]
WIP
Comment 41 Saam Barati 2018-10-15 11:45:35 PDT 
Created attachment 352352 [details]
WIP
Comment 42 Saam Barati 2018-10-18 13:33:55 PDT 
Rubber stamped by Mark Lam.
Comment 43 Saam Barati 2018-10-18 14:12:12 PDT 
landed in:
https://trac.webkit.org/changeset/237263/webkit