Bug 187829

Summary: Make JetStream 2
Product: WebKit Reporter: Saam Barati <saam>
Component: JavaScriptCoreAssignee: Saam Barati <saam>
Status: RESOLVED FIXED    
Severity: Normal CC: benjamin, cdumez, dean_johnson, ews-watchlist, fpizlo, ggaren, gskachkov, jfbastien, jond, keith_miller, luke, mark.lam, mkwst, msaboff, rmorisset, rniwa, ticaiolima, webkit-bug-importer, ysuzuki
Priority: P2    
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP
none
WIP none

Saam Barati
Reported 2018-07-19 16:53:18 PDT
Goals: - measure start up, worst case, and peak perf - measure newer JS features - measure Wasm - measure Promise perf Ideas: - most tests from JetStream 1 - replace some asm.js tests with Wasm tests - include all of ARES-6 - worker bomb test - WSL test - kraken, maybe, if license issue works out - include RexBench - include ToolingBench (or some parts of it) - some code load test that uses newer source code that includes ES6+ language features - use {1st iteration, worst 4, average time} style of measuring iterations like ARES-6 on all subtests (or most, we need to figure out what that means on SunSpider subtests) - one subtest should simply be measure of total running time of benchmark. So if you hide demons in between benchmark runs, you'll be penalized by at least one subtest (we could even weight this more than just 1 test too)
Attachments
WIP (26.01 MB, patch)
2018-07-19 16:54 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (56.92 MB, patch)
2018-07-20 17:30 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (56.92 MB, patch)
2018-07-26 13:53 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (57.58 MB, patch)
2018-07-27 15:55 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (57.58 MB, patch)
2018-07-27 18:07 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (57.58 MB, patch)
2018-07-29 14:55 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (57.69 MB, patch)
2018-07-30 18:17 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (57.69 MB, patch)
2018-07-30 18:50 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (57.94 MB, patch)
2018-07-31 18:04 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (57.94 MB, patch)
2018-07-31 18:34 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (58.77 MB, patch)
2018-08-01 15:43 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (58.77 MB, patch)
2018-08-01 17:24 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (59.26 MB, patch)
2018-08-01 19:06 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (59.26 MB, patch)
2018-08-02 17:22 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (66.25 MB, patch)
2018-08-02 21:11 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (69.18 MB, patch)
2018-08-06 13:37 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (70.01 MB, patch)
2018-08-06 18:19 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (70.01 MB, patch)
2018-08-06 18:26 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (70.08 MB, patch)
2018-08-06 20:48 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (70.16 MB, patch)
2018-08-07 14:11 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (70.16 MB, patch)
2018-08-07 14:13 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (72.18 MB, patch)
2018-08-10 19:29 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (72.19 MB, patch)
2018-08-13 16:39 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (72.19 MB, patch)
2018-08-13 17:41 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (72.19 MB, patch)
2018-08-13 17:46 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (72.19 MB, patch)
2018-08-21 19:16 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (72.19 MB, patch)
2018-08-22 15:36 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (72.19 MB, patch)
2018-08-22 19:59 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (72.19 MB, patch)
2018-08-22 22:17 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (72.68 MB, patch)
2018-08-23 22:29 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (72.58 MB, patch)
2018-08-24 17:29 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (72.58 MB, patch)
2018-08-27 11:17 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (72.59 MB, patch)
2018-08-27 16:13 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (65.10 MB, patch)
2018-08-28 18:20 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (65.10 MB, patch)
2018-08-28 20:38 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (65.10 MB, patch)
2018-08-28 23:32 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (65.10 MB, patch)
2018-08-29 18:50 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (65.16 MB, patch)
2018-08-30 13:19 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (65.03 MB, patch)
2018-08-30 16:31 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (65.03 MB, patch)
2018-08-30 17:54 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
WIP (209.02 MB, patch)
2018-10-15 11:45 PDT, Saam Barati 		no flags
DetailsFormatted DiffDiff
Show Obsolete (40) View All Add attachment proposed patch, testcase, etc.
Saam Barati
Comment 1 2018-07-19 16:54:33 PDT
Created attachment 345400 [details] WIP
Saam Barati
Comment 2 2018-07-20 17:30:04 PDT
Created attachment 345494 [details] WIP
Saam Barati
Comment 3 2018-07-26 13:53:23 PDT
Created attachment 345862 [details] WIP
Saam Barati
Comment 4 2018-07-27 15:55:50 PDT
Created attachment 345964 [details] WIP
Saam Barati
Comment 5 2018-07-27 18:07:08 PDT
Created attachment 345981 [details] WIP
Saam Barati
Comment 6 2018-07-29 14:55:30 PDT
Created attachment 346043 [details] WIP
Saam Barati
Comment 7 2018-07-30 18:17:30 PDT
Created attachment 346134 [details] WIP
Saam Barati
Comment 8 2018-07-30 18:50:19 PDT
Created attachment 346137 [details] WIP
Saam Barati
Comment 9 2018-07-31 18:04:51 PDT
Created attachment 346240 [details] WIP Currently the benchmark is using a crazy amount of memory. Need to figure out what's going on.
Saam Barati
Comment 10 2018-07-31 18:34:12 PDT
Created attachment 346246 [details] WIP
Saam Barati
Comment 11 2018-08-01 15:43:06 PDT
Created attachment 346307 [details] WIP add bomb-workers
Saam Barati
Comment 12 2018-08-01 17:24:35 PDT
Created attachment 346314 [details] WIP
Saam Barati
Comment 13 2018-08-01 19:06:37 PDT
Created attachment 346352 [details] WIP starting to add some stanford crypto tests
Saam Barati
Comment 14 2018-08-02 17:22:17 PDT
Created attachment 346436 [details] WIP
Saam Barati
Comment 15 2018-08-02 21:11:06 PDT
Created attachment 346449 [details] WIP
Saam Barati
Comment 16 2018-08-06 13:37:07 PDT
Created attachment 346651 [details] WIP
Saam Barati
Comment 17 2018-08-06 18:19:43 PDT
Created attachment 346672 [details] WIP Mostly runs on the CLI now. Just web tooling bench doesn't. I need to figure that out.
Saam Barati
Comment 18 2018-08-06 18:26:48 PDT
Created attachment 346674 [details] WIP
Saam Barati
Comment 19 2018-08-06 20:48:50 PDT
Created attachment 346681 [details] WIP
Saam Barati
Comment 20 2018-08-07 14:11:59 PDT
Created attachment 346732 [details] WIP
Saam Barati
Comment 21 2018-08-07 14:13:42 PDT
Created attachment 346733 [details] WIP
Saam Barati
Comment 22 2018-08-10 19:29:52 PDT
Created attachment 346952 [details] WIP
Saam Barati
Comment 23 2018-08-13 16:39:07 PDT
Created attachment 347053 [details] WIP
Saam Barati
Comment 24 2018-08-13 17:41:43 PDT
Created attachment 347057 [details] WIP
Saam Barati
Comment 25 2018-08-13 17:46:44 PDT
Created attachment 347058 [details] WIP
Saam Barati
Comment 26 2018-08-21 19:16:55 PDT
Created attachment 347752 [details] WIP
Saam Barati
Comment 27 2018-08-22 15:36:51 PDT
Created attachment 347856 [details] WIP
Saam Barati
Comment 28 2018-08-22 19:59:49 PDT
Created attachment 347897 [details] WIP
Saam Barati
Comment 29 2018-08-22 22:17:11 PDT
Created attachment 347899 [details] WIP
Saam Barati
Comment 30 2018-08-23 22:29:50 PDT
Created attachment 347992 [details] WIP Added ai-astar. Also, completed the trifecta of code load tests; we're gonna have: 1. Octane code-first-load from JetStream1 2. multi-code-load inspector, where we actually load identical programs with some frequency. 3. first-code-load inspector, where we load unique programs each time.
Saam Barati
Comment 31 2018-08-24 17:29:59 PDT
Created attachment 348061 [details] WIP
Saam Barati
Comment 32 2018-08-27 11:17:23 PDT
Created attachment 348170 [details] WIP
Saam Barati
Comment 33 2018-08-27 16:13:51 PDT
Created attachment 348231 [details] WIP
Saam Barati
Comment 34 2018-08-28 18:20:34 PDT
Created attachment 348372 [details] WIP
Saam Barati
Comment 35 2018-08-28 20:38:12 PDT
Created attachment 348385 [details] WIP
Saam Barati
Comment 36 2018-08-28 23:32:10 PDT
Created attachment 348394 [details] WIP
Saam Barati
Comment 37 2018-08-29 18:50:25 PDT
Created attachment 348461 [details] WIP
Saam Barati
Comment 38 2018-08-30 13:19:34 PDT
Created attachment 348535 [details] WIP
Saam Barati
Comment 39 2018-08-30 16:31:33 PDT
Created attachment 348564 [details] WIP
Saam Barati
Comment 40 2018-08-30 17:54:22 PDT
Created attachment 348576 [details] WIP
Saam Barati
Comment 41 2018-10-15 11:45:35 PDT
Created attachment 352352 [details] WIP
Saam Barati
Comment 42 2018-10-18 13:33:55 PDT
Rubber stamped by Mark Lam.
Saam Barati
Comment 43 2018-10-18 14:12:12 PDT
landed in: https://trac.webkit.org/changeset/237263/webkit
Note You need to log in before you can comment on or make changes to this bug.