Bug 74804 – DFG 32_64 should eagerly speculate Int32 and Cell on heap loads

• Status: NEW
• Component: JavaScriptCore

[Filip Pizlo]

Patch forthcoming.

[Filip Pizlo]

Created attachment 119751 [details]
the patch

Benchmark report for SunSpider, V8, and Kraken on nitroflex (MacBookPro8,2).

VMs tested:
"TipOfTree32" at /Volumes/Data/pizlo/quinary/OpenSource/WebKitBuild/Release/jsc (r103166)
"EagerIntCell32" at /Volumes/Data/pizlo/quartary/OpenSource/WebKitBuild/Release/jsc (r103166)

Collected 12 samples per benchmark/VM, with 4 VM invocations per benchmark. Emitted a call to gc() between sample
measurements. Used 1 benchmark iteration per VM invocation for warm-up. Used the jsc-specific preciseTime()
function to get microsecond-level timing. Reporting benchmark execution times with 95% confidence intervals in
milliseconds.

                                           TipOfTree32            EagerIntCell32                                 
SunSpider:
   3d-cube                                6.5152+-0.1034    !     6.9520+-0.1399       ! definitely 1.0671x slower
   3d-morph                              10.5681+-0.1076         10.5453+-0.0857       
   3d-raytrace                            9.2411+-0.1250    ?     9.2665+-0.1191       ?
   access-binary-trees                    1.7557+-0.0412          1.7321+-0.0354         might be 1.0136x faster
   access-fannkuch                        7.9326+-0.1010    ^     7.2286+-0.0862       ^ definitely 1.0974x faster
   access-nbody                           5.1912+-0.0406          5.1522+-0.0602       
   access-nsieve                          2.6116+-0.0499          2.5841+-0.0483         might be 1.0106x faster
   bitops-3bit-bits-in-byte               1.2822+-0.0254    ^     1.2343+-0.0084       ^ definitely 1.0389x faster
   bitops-bits-in-byte                    2.4810+-0.0537    ?     2.5142+-0.0676       ? might be 1.0134x slower
   bitops-bitwise-and                     2.8281+-0.0258    ?     2.8735+-0.0348       ? might be 1.0161x slower
   bitops-nsieve-bits                     6.2589+-0.1028    ?     6.3116+-0.0845       ?
   controlflow-recursive                  2.5813+-0.0530          2.5580+-0.0432       
   crypto-aes                             9.2850+-0.1267          9.1234+-0.1779         might be 1.0177x faster
   crypto-md5                             3.0472+-0.0484          3.0451+-0.0386       
   crypto-sha1                            2.6046+-0.0640          2.5974+-0.0537       
   date-format-tofte                     10.6983+-0.1870         10.5845+-0.1181         might be 1.0108x faster
   date-format-xparb                     10.4971+-0.1022    ?    10.5607+-0.1040       ?
   math-cordic                            8.2823+-0.0975          8.2167+-0.1438       
   math-partial-sums                      9.7506+-0.0925          9.6517+-0.0738         might be 1.0102x faster
   math-spectral-norm                     2.5231+-0.0492          2.4600+-0.0363         might be 1.0257x faster
   regexp-dna                             7.9393+-0.1087    ?     7.9501+-0.1697       ?
   string-base64                          4.8136+-0.1001          4.7835+-0.0954       
   string-fasta                           7.8033+-0.1175    ?     7.8557+-0.1087       ?
   string-tagcloud                       12.3709+-0.2043    ?    12.5135+-0.2845       ? might be 1.0115x slower
   string-unpack-code                    20.2817+-0.2596         19.9612+-0.1532         might be 1.0161x faster
   string-validate-input                  5.9654+-0.1052    ?     6.0222+-0.1078       ?

   <arithmetic> *                         6.7350+-0.0203          6.7030+-0.0182         might be 1.0048x faster
   <geometric>                            5.4351+-0.0137    ^     5.4078+-0.0126       ^ definitely 1.0050x faster
   <harmonic>                             4.2599+-0.0170    ^     4.2245+-0.0112       ^ definitely 1.0084x faster

                                           TipOfTree32            EagerIntCell32                                 
V8:
   crypto                                95.5250+-1.3538    ?    96.4640+-0.5734       ?
   deltablue                            158.2678+-1.7653    ^   154.4879+-0.5682       ^ definitely 1.0245x faster
   earley-boyer                          94.1228+-1.1494    ?    94.3708+-0.9196       ?
   raytrace                              51.6229+-0.5621    ?    51.8910+-1.1234       ?
   regexp                               109.8100+-0.8648        108.6379+-0.3674         might be 1.0108x faster
   richards                             169.3354+-0.4180    ^   163.4216+-1.8519       ^ definitely 1.0362x faster
   splay                                 81.9789+-1.2006         80.7980+-0.8816         might be 1.0146x faster

   <arithmetic>                         108.6661+-0.4893    ^   107.1530+-0.4445       ^ definitely 1.0141x faster
   <geometric> *                        101.6176+-0.4695        100.6451+-0.5093         might be 1.0097x faster
   <harmonic>                            94.5797+-0.4440         94.0507+-0.6585         might be 1.0056x faster

                                           TipOfTree32            EagerIntCell32                                 
Kraken:
   ai-astar                             532.2392+-3.9922    ?   534.4831+-4.9855       ?
   audio-beat-detection                 350.2439+-9.9496        336.6175+-4.8982         might be 1.0405x faster
   audio-dft                            377.7458+-3.6279    !   388.8345+-7.3560       ! definitely 1.0294x slower
   audio-fft                            208.5070+-1.7687        208.3388+-0.9079       
   audio-oscillator                     416.5024+-6.2843        411.9362+-1.4885         might be 1.0111x faster
   imaging-darkroom                     367.0025+-4.2294    ?   370.3441+-3.8998       ?
   imaging-desaturate                   266.8889+-1.2328    ^   260.8575+-1.9483       ^ definitely 1.0231x faster
   imaging-gaussian-blur                600.8885+-2.4145    ^   545.8639+-0.9871       ^ definitely 1.1008x faster
   json-parse-financial                  61.4667+-0.2622    ^    60.7386+-0.4464       ^ definitely 1.0120x faster
   json-stringify-tinderbox              94.9131+-0.9780    ^    92.4179+-0.7361       ^ definitely 1.0270x faster
   stanford-crypto-aes                  115.3358+-1.3787    ^   110.1062+-0.4967       ^ definitely 1.0475x faster
   stanford-crypto-ccm                  111.7851+-0.8190        111.2815+-0.7619       
   stanford-crypto-pbkdf2               219.6226+-0.8071    ?   220.5950+-0.8563       ?
   stanford-crypto-sha256-iterative      98.3436+-0.5314         97.5897+-0.3802       

   <arithmetic> *                       272.9632+-1.1985    ^   267.8575+-0.7008       ^ definitely 1.0191x faster
   <geometric>                          218.9986+-0.8108    ^   215.5792+-0.4689       ^ definitely 1.0159x faster
   <harmonic>                           171.0000+-0.5759    ^   168.3718+-0.3686       ^ definitely 1.0156x faster

                                           TipOfTree32            EagerIntCell32                                 
All benchmarks:
   <arithmetic>                         101.2182+-0.3439    ^    99.4543+-0.2435       ^ definitely 1.0177x faster
   <geometric>                           25.2796+-0.0549    ^    25.0555+-0.0324       ^ definitely 1.0089x faster
   <harmonic>                             7.5088+-0.0295    ^     7.4460+-0.0194       ^ definitely 1.0084x faster

                                           TipOfTree32            EagerIntCell32                                 
Geomean of preferred means:
   <scaled-result>                       57.1650+-0.1089    ^    56.5350+-0.1051       ^ definitely 1.0111x faster

[Filip Pizlo]

<rdar://problem/10592116>

[Filip Pizlo]

There's definitely something fishy with this patch.  I tried to see which of the two eager speculations were more profitable: cell or int32. So I created four total version of this patch:

1) Control. This has eager speculations disabled by having the actual functionality guarded by if (false), but everything else in place.

2) Int: only speculate eagerly on Int32

3) Cell: same but for cell

4) IntCell: both eager speculations.

The results show a significant Kraken slow-down on Control.  Will have to look at this more.



[pizlo@nitroflex bencher] ./bencher TipOfTree32:/Volumes/Data/pizlo/quinary/OpenSource/WebKitBuild/Release/jsc Control:/Volumes/Data/pizlo/quartary/OpenSource/Control/Release/jsc EagerCell32:/Volumes/Data/pizlo/quartary/OpenSource/JustCell/Release/jsc EagerInt32:/Volumes/Data/pizlo/quartary/OpenSource/JustInt32/Release/jsc EagerIntCell32:/Volumes/Data/pizlo/quartary/OpenSource/BothIntAndCell/Release/jsc --local --remote oldmac,bigmac
Warning: could not identify checkout location for Control
Warning: could not identify checkout location for EagerCell32
Warning: could not identify checkout location for EagerInt32
Warning: could not identify checkout location for EagerIntCell32
Copying TipOfTree32 into /Volumes/Data/pizlo/bencher/temp/benchdata...
Copying Control into /Volumes/Data/pizlo/bencher/temp/benchdata...
Copying EagerCell32 into /Volumes/Data/pizlo/bencher/temp/benchdata...
Copying EagerInt32 into /Volumes/Data/pizlo/bencher/temp/benchdata...
Copying EagerIntCell32 into /Volumes/Data/pizlo/bencher/temp/benchdata...
All VMs are in place.
Packaging benchmarking directory for remote hosts...
Sending benchmark payload to oldmac...
Running on oldmac...
940/940                                                             
Generating benchmark report at TipOfTree32_Control_EagerCell32_EagerInt32_EagerIntCell32_SunSpiderV8Kraken_oldmac_20111218_2338_benchReport.txt

Benchmark report for SunSpider, V8, and Kraken on oldmac (MacPro4,1).

VMs tested:
"TipOfTree32" at /Volumes/Data/pizlo/quinary/OpenSource/WebKitBuild/Release/jsc (r103205)
"Control" at /Volumes/Data/pizlo/quartary/OpenSource/Control/Release/jsc
"EagerCell32" at /Volumes/Data/pizlo/quartary/OpenSource/JustCell/Release/jsc
"EagerInt32" at /Volumes/Data/pizlo/quartary/OpenSource/JustInt32/Release/jsc
"EagerIntCell32" at /Volumes/Data/pizlo/quartary/OpenSource/BothIntAndCell/Release/jsc

Collected 12 samples per benchmark/VM, with 4 VM invocations per benchmark. Emitted a call to gc() between sample measurements. Used 1 benchmark iteration per VM invocation for warm-up.
Used the jsc-specific preciseTime() function to get microsecond-level timing. Reporting benchmark execution times with 95% confidence intervals in milliseconds.

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
SunSpider:
   3d-cube                                8.7318+-0.0206    ?     8.7479+-0.0222    !     8.8039+-0.0185    !     9.4689+-0.0255    ?     9.4717+-0.0242       ! definitely 1.0847x slower
   3d-morph                              13.2629+-0.0406    ?    13.2753+-0.0375    ?    13.2935+-0.0401         13.2537+-0.0360         13.2495+-0.0355       
   3d-raytrace                           11.6782+-0.0393         11.6765+-0.0100    !    11.7175+-0.0168    ?    11.8153+-0.0904         11.7703+-0.0166       ! definitely 1.0079x slower
   access-binary-trees                    2.3448+-0.0094    ^     2.3071+-0.0137          2.2937+-0.0117    !     2.3275+-0.0115    ^     2.2859+-0.0122       ^ definitely 1.0258x faster
   access-fannkuch                       11.3003+-0.0256    !    11.4104+-0.0161    ?    11.4182+-0.0235    ^    11.1282+-0.0239    ?    11.1454+-0.0122       ^ definitely 1.0139x faster
   access-nbody                           6.8996+-0.0084    ^     6.8553+-0.0074    !     6.8895+-0.0048    ^     6.8691+-0.0146    ?     6.8934+-0.0123       
   access-nsieve                          3.7322+-0.0050    ?     3.7564+-0.0351          3.7359+-0.0061    ?     3.7394+-0.0039          3.7343+-0.0048       ?
   bitops-3bit-bits-in-byte               1.5421+-0.0109    ?     1.5599+-0.0269    ?     1.5734+-0.0276          1.5600+-0.0264          1.5530+-0.0242       ?
   bitops-bits-in-byte                    6.0217+-0.0083    ?     6.0421+-0.0199          6.0395+-0.0187          6.0143+-0.0071    ?     6.0340+-0.0168       ?
   bitops-bitwise-and                     4.7019+-0.0175          4.6918+-0.0142          4.6897+-0.0128    !     4.7390+-0.0069    ?     4.7440+-0.0080       ! definitely 1.0089x slower
   bitops-nsieve-bits                     8.1847+-0.0122          8.1735+-0.0128    ?     8.1807+-0.0176    ?     8.1830+-0.0175    ?     8.2074+-0.0165       ?
   controlflow-recursive                  3.6644+-0.0082    ?     3.6887+-0.0370          3.6483+-0.0051    !     3.6708+-0.0053    ^     3.6469+-0.0061       ^ definitely 1.0048x faster
   crypto-aes                            12.1206+-0.0412    !    12.5194+-0.0511    ^    12.3134+-0.0661    ^    12.1889+-0.0481    ^    11.9197+-0.0457       ^ definitely 1.0169x faster
   crypto-md5                             3.9542+-0.0278    ?     3.9928+-0.0305          3.9508+-0.0285    ?     3.9681+-0.0228    ?     3.9698+-0.0282       ?
   crypto-sha1                            3.3051+-0.0085    !     3.3614+-0.0153    ?     3.3682+-0.0119    ^     3.3168+-0.0219    ?     3.3419+-0.0209       ! definitely 1.0111x slower
   date-format-tofte                     13.9086+-0.0842         13.9041+-0.1466         13.8380+-0.0755         13.7874+-0.1152    ?    13.7889+-0.0746       
   date-format-xparb                     14.2860+-0.0656    !    14.9952+-0.2560    ^    14.4186+-0.2637    ?    14.4634+-0.0825         14.3511+-0.1256       ?
   math-cordic                           12.0051+-0.0349    ?    12.0180+-0.0346    ?    12.0405+-0.0325         12.0243+-0.0381    ?    12.0592+-0.0470       ?
   math-partial-sums                     15.0402+-0.0134         15.0169+-0.0118    ?    15.0505+-0.0619    ?    15.0630+-0.0389         15.0338+-0.0216       
   math-spectral-norm                     3.2868+-0.0046    !     3.3098+-0.0124    ^     3.2840+-0.0094    ?     3.3140+-0.0240    ^     3.2782+-0.0040       ^ definitely 1.0027x faster
   regexp-dna                            11.1242+-0.0351         11.1180+-0.0320    ?    11.1321+-0.0352         11.1187+-0.0337    ?    11.1785+-0.0654       ?
   string-base64                          5.9700+-0.0185    !     6.0209+-0.0174          5.9702+-0.0425    ?     6.0021+-0.0064    !     6.0358+-0.0084       ! definitely 1.0110x slower
   string-fasta                          10.5009+-0.0663         10.4781+-0.0185         10.4596+-0.0138         10.4517+-0.0137    ?    10.4759+-0.0154       
   string-tagcloud                       16.5245+-0.0492    ?    16.6031+-0.0481    ^    16.4980+-0.0307    !    16.6524+-0.0608         16.5581+-0.0374       ?
   string-unpack-code                    26.6542+-0.0978    ?    26.6837+-0.0884    ?    26.7645+-0.0989    !    27.0689+-0.1923    ^    26.7331+-0.1127       ?
   string-validate-input                  7.6256+-0.0232    ?     7.6628+-0.0146          7.6274+-0.0499    ?     7.6407+-0.0189    ?     7.6646+-0.0653       ?

   <arithmetic> *                         9.1681+-0.0147    !     9.2257+-0.0219          9.1923+-0.0155    ?     9.2242+-0.0188          9.1971+-0.0147       ? might be 1.0032x slower
   <geometric>                            7.4811+-0.0123    !     7.5225+-0.0176          7.4975+-0.0143    ?     7.5212+-0.0170          7.5051+-0.0146       ? might be 1.0032x slower
   <harmonic>                             5.8539+-0.0131    ?     5.8821+-0.0231          5.8683+-0.0212    ?     5.8821+-0.0232          5.8645+-0.0211       ? might be 1.0018x slower

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
V8:
   crypto                               121.8289+-0.4453    !   126.1234+-0.4726    ^   123.1796+-0.5094        122.9165+-0.5291    ^   121.1590+-0.5285       
   deltablue                            226.0008+-1.0798        224.2036+-0.9799    ^   221.3942+-1.1447    !   223.4072+-0.7185    ^   221.3443+-1.2569       ^ definitely 1.0210x faster
   earley-boyer                         143.1300+-1.3851    ?   143.5826+-1.7801        142.0191+-1.6713    ?   143.8748+-1.4920        142.0498+-1.3735       
   raytrace                              68.8921+-0.2200    ^    68.0308+-0.2554    ?    68.3254+-0.5471    ?    69.2902+-0.6386         69.0949+-0.3306       ?
   regexp                               153.4198+-0.4170        153.3656+-0.4209    ?   153.8082+-0.6626    ?   154.2303+-0.7662        153.3607+-0.5203       
   richards                             239.7321+-0.7279    ^   236.9748+-1.1710    ^   229.8522+-0.6694    !   238.8874+-1.3089    ^   228.0728+-1.6240       ^ definitely 1.0511x faster
   splay                                118.0435+-1.3747        116.2175+-1.5273    ?   117.5264+-1.2249        117.2225+-1.3448        116.8798+-1.3623       

   <arithmetic>                         153.0067+-0.4246        152.6426+-0.4052    ^   150.8721+-0.4812    !   152.8327+-0.3884    ^   150.2802+-0.5252       ^ definitely 1.0181x faster
   <geometric> *                        142.2467+-0.4208        142.0353+-0.3882    ^   140.8386+-0.4932    !   142.3062+-0.4086    ^   140.4060+-0.4899       ^ definitely 1.0131x faster
   <harmonic>                           131.3322+-0.3958        131.0768+-0.3456        130.4057+-0.5121    !   131.5752+-0.4697    ^   130.2329+-0.4460       ^ definitely 1.0084x faster

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
Kraken:
   ai-astar                             988.0788+-1.6338    !  1001.3776+-1.4731       1001.3068+-1.6581       1000.5687+-1.3337       1000.5236+-1.5517       ! definitely 1.0126x slower
   audio-beat-detection                 435.6670+-0.8384    !   447.1157+-0.9294    ?   447.3081+-2.0877    !   451.3513+-0.8013    ^   444.1357+-0.6483       ! definitely 1.0194x slower
   audio-dft                            444.2367+-5.1701    !   458.9402+-2.5081    ^   454.3556+-2.0733    !   459.4940+-2.1597    ^   453.2168+-2.1005       ! definitely 1.0202x slower
   audio-fft                            267.2892+-0.5793    !   278.0532+-0.7684    ?   278.5907+-1.3102        278.2406+-0.9339        277.5134+-1.5167       ! definitely 1.0383x slower
   audio-oscillator                     537.5733+-2.7632    ?   539.3108+-1.5395    !   543.3890+-2.2696    ?   543.6902+-0.4835    ^   538.4721+-2.2220       ?
   imaging-darkroom                     472.7644+-4.8700    ?   473.2457+-4.9629    ?   477.3557+-7.4831        472.8561+-5.0028    ?   476.1891+-6.6622       ?
   imaging-desaturate                   359.8268+-0.2506    ^   358.0175+-0.0843    ?   358.1182+-0.0506    ?   358.1279+-0.1200        358.1198+-0.1336       ^ definitely 1.0048x faster
   imaging-gaussian-blur                855.8991+-0.3269    ?   857.5905+-2.3498    ^   819.2830+-0.2085    ^   816.9008+-0.8720    ^   767.6744+-0.2413       ^ definitely 1.1149x faster
   json-parse-financial                  89.0504+-0.2358    !    89.6522+-0.2058    ^    88.7239+-0.2067    !    89.7405+-0.1255    ^    88.7932+-0.3244       
   json-stringify-tinderbox             128.4641+-0.2895        128.2169+-0.7026    ?   128.2388+-0.4634    ?   128.9169+-0.3147    ^   127.5880+-0.3585       ^ definitely 1.0069x faster
   stanford-crypto-aes                  169.1226+-0.6672    !   171.6664+-0.5933    ^   169.7603+-0.5412    ?   170.4990+-0.4678    ^   164.1166+-0.4307       ^ definitely 1.0305x faster
   stanford-crypto-ccm                  158.3237+-5.3509        155.4516+-1.2658    ?   155.5762+-0.9642        155.2959+-1.0096        153.8449+-0.5615         might be 1.0291x faster
   stanford-crypto-pbkdf2               310.5128+-0.5477    !   315.6918+-0.8011    ^   314.1845+-0.3754    ^   310.6858+-0.3697    !   314.8788+-0.7839       ! definitely 1.0141x slower
   stanford-crypto-sha256-iterative     133.2024+-0.2953        132.6954+-0.3863    ?   132.9822+-0.4908    ^   131.9803+-0.2355    !   132.6596+-0.3477       

   <arithmetic> *                       382.1437+-0.5140    !   386.2161+-0.4472    ^   383.5123+-0.6870        383.4534+-0.3695    ^   378.4090+-0.6253       ^ definitely 1.0099x faster
   <geometric>                          301.2130+-0.6552    !   303.9776+-0.4061    ^   302.6707+-0.5448    ?   302.8239+-0.3250    ^   299.6524+-0.5294       ^ definitely 1.0052x faster
   <harmonic>                           236.4481+-0.7261    !   237.8735+-0.3839    ^   237.0256+-0.3884    ?   237.4589+-0.2831    ^   235.2075+-0.4443       ^ definitely 1.0053x faster

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
All benchmarks:
   <arithmetic>                         141.6900+-0.2048    !   142.8807+-0.1723    ^   141.7931+-0.2601    ?   142.0852+-0.1594    ^   140.1875+-0.2456       ^ definitely 1.0107x faster
   <geometric>                           34.8757+-0.0555    !    35.0698+-0.0624    ^    34.9165+-0.0683    ?    35.0368+-0.0627    ^    34.8160+-0.0665         might be 1.0017x faster
   <harmonic>                            10.3205+-0.0227    ?    10.3697+-0.0401         10.3448+-0.0368    ?    10.3699+-0.0402         10.3371+-0.0367       ? might be 1.0016x slower

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
Geomean of preferred means:
   <scaled-result>                       79.2834+-0.1362    !    79.6908+-0.1351    ^    79.1846+-0.1637    !    79.5465+-0.1266    ^    78.7647+-0.1512       ^ definitely 1.0066x faster

Sending benchmark payload to bigmac...
Running on bigmac...
940/940                                                             
Generating benchmark report at TipOfTree32_Control_EagerCell32_EagerInt32_EagerIntCell32_SunSpiderV8Kraken_bigmac_20111218_2348_benchReport.txt

Benchmark report for SunSpider, V8, and Kraken on bigmac (MacPro5,1).

VMs tested:
"TipOfTree32" at /Volumes/Data/pizlo/quinary/OpenSource/WebKitBuild/Release/jsc (r103205)
"Control" at /Volumes/Data/pizlo/quartary/OpenSource/Control/Release/jsc
"EagerCell32" at /Volumes/Data/pizlo/quartary/OpenSource/JustCell/Release/jsc
"EagerInt32" at /Volumes/Data/pizlo/quartary/OpenSource/JustInt32/Release/jsc
"EagerIntCell32" at /Volumes/Data/pizlo/quartary/OpenSource/BothIntAndCell/Release/jsc

Collected 12 samples per benchmark/VM, with 4 VM invocations per benchmark. Emitted a call to gc() between sample measurements. Used 1 benchmark iteration per VM invocation for warm-up.
Used the jsc-specific preciseTime() function to get microsecond-level timing. Reporting benchmark execution times with 95% confidence intervals in milliseconds.

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
SunSpider:
   3d-cube                                7.2654+-0.0133          7.2617+-0.0138    !     7.2951+-0.0144    !     7.8291+-0.0137    !     7.8575+-0.0115       ! definitely 1.0815x slower
   3d-morph                              10.9658+-0.0332         10.9517+-0.0350    ?    10.9855+-0.0400    ?    10.9926+-0.0269         10.9797+-0.0352       ?
   3d-raytrace                            9.6582+-0.0179    !     9.7457+-0.0266    ?     9.7552+-0.0183    ?     9.7799+-0.0194    ?     9.8546+-0.0661       ! definitely 1.0203x slower
   access-binary-trees                    1.9276+-0.0081          1.9177+-0.0127    ^     1.8906+-0.0073    !     1.9278+-0.0054    ^     1.8873+-0.0131       ^ definitely 1.0214x faster
   access-fannkuch                        9.3461+-0.0233    !     9.4206+-0.0070    ?     9.4335+-0.0090    ^     9.1983+-0.0056    ?     9.2067+-0.0094       ^ definitely 1.0151x faster
   access-nbody                           5.7141+-0.0037    ^     5.6899+-0.0057    ?     5.6964+-0.0040          5.6875+-0.0051    !     5.7072+-0.0049       
   access-nsieve                          3.1269+-0.0039          3.1252+-0.0059          3.1243+-0.0126    ?     3.1329+-0.0047          3.1291+-0.0056       ?
   bitops-3bit-bits-in-byte               1.2902+-0.0202          1.2895+-0.0193    ?     1.3028+-0.0190          1.2964+-0.0201          1.2948+-0.0182       ?
   bitops-bits-in-byte                    4.9842+-0.0195    ?     4.9998+-0.0194          4.9769+-0.0082    ?     4.9792+-0.0192          4.9770+-0.0135       
   bitops-bitwise-and                     3.8748+-0.0180    ?     3.8878+-0.0130          3.8868+-0.0100    !     3.9210+-0.0095    ?     3.9280+-0.0113       ! definitely 1.0137x slower
   bitops-nsieve-bits                     6.7597+-0.0056          6.7563+-0.0098    ?     6.7600+-0.0100          6.7580+-0.0077    !     6.7835+-0.0125       ! definitely 1.0035x slower
   controlflow-recursive                  3.0111+-0.0057    ?     3.0302+-0.0245          2.9958+-0.0125    !     3.0196+-0.0064          3.0073+-0.0236       
   crypto-aes                            10.0469+-0.0346    !    10.4278+-0.0298         10.2985+-0.1357    ^    10.1006+-0.0274    ^     9.9996+-0.0460       
   crypto-md5                             3.2757+-0.0212    ?     3.3172+-0.0204          3.2809+-0.0256    ?     3.3199+-0.0219          3.2959+-0.0177       ?
   crypto-sha1                            2.7412+-0.0108    !     2.7903+-0.0146          2.7808+-0.0147          2.7651+-0.0255    ?     2.8015+-0.0322       ! definitely 1.0220x slower
   date-format-tofte                     11.4606+-0.0577    ?    11.5339+-0.0800         11.4521+-0.0476         11.3878+-0.0340    ?    11.4031+-0.0488       
   date-format-xparb                     11.8725+-0.0259    !    12.4146+-0.1292    ^    11.7103+-0.0761    !    12.0641+-0.0846    ^    11.7498+-0.0662       ^ definitely 1.0104x faster
   math-cordic                            9.9470+-0.0235    ?     9.9480+-0.0262    ?     9.9752+-0.0178          9.9438+-0.0265    ?     9.9442+-0.0214       
   math-partial-sums                     12.4418+-0.0180    ?    12.4441+-0.0183    ?    12.4626+-0.0123         12.4501+-0.0254         12.4438+-0.0084       ?
   math-spectral-norm                     2.7444+-0.0168          2.7441+-0.0034    ^     2.7278+-0.0047    !     2.7443+-0.0085    ^     2.7206+-0.0029       ^ definitely 1.0087x faster
   regexp-dna                             9.2059+-0.0603          9.1753+-0.0126    ?     9.1766+-0.0096    ?     9.1795+-0.0120    ?     9.2319+-0.0555       ?
   string-base64                          4.8940+-0.0060    !     4.9161+-0.0111          4.9159+-0.0070          4.9044+-0.0101    !     4.9673+-0.0457       ! definitely 1.0150x slower
   string-fasta                           8.6852+-0.0718          8.6488+-0.0150    ?     8.6547+-0.0109          8.6545+-0.0148          8.6454+-0.0116       
   string-tagcloud                       13.6750+-0.0450    !    13.8188+-0.0274    ^    13.7395+-0.0366    ?    13.7704+-0.0430         13.7426+-0.0396       ?
   string-unpack-code                    22.0746+-0.0623    ?    22.2830+-0.1703         22.1407+-0.0516    !    22.4148+-0.1506    ^    22.0658+-0.0613       
   string-validate-input                  6.2945+-0.0161    !     6.3402+-0.0150    ^     6.2909+-0.0082    ?     6.3075+-0.0099    ?     6.3276+-0.0179       ?

   <arithmetic> *                         7.5878+-0.0079    !     7.6492+-0.0099    ^     7.6042+-0.0096    !     7.6357+-0.0113          7.6135+-0.0139       ! definitely 1.0034x slower
   <geometric>                            6.1934+-0.0095    !     6.2315+-0.0103    ^     6.2023+-0.0099    !     6.2284+-0.0102          6.2179+-0.0123       ! definitely 1.0040x slower
   <harmonic>                             4.8516+-0.0163    ?     4.8712+-0.0168          4.8550+-0.0156    ?     4.8760+-0.0158          4.8648+-0.0141       ? might be 1.0027x slower

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
V8:
   crypto                               101.0272+-0.2761    !   105.0094+-0.2167    ^   102.1054+-0.4952        101.5313+-0.4064    ^   100.1380+-0.4140       ^ definitely 1.0089x faster
   deltablue                            187.5219+-1.1094    ^   184.9778+-0.8675        184.4864+-0.6554    ?   185.1880+-0.9789        184.2742+-0.4935       ^ definitely 1.0176x faster
   earley-boyer                         118.6930+-1.2973    ?   119.5264+-1.4073        117.7628+-1.3218    ?   119.5376+-1.0991        118.0537+-0.9098       
   raytrace                              57.5928+-0.4654    ^    56.3210+-0.2511    ?    56.7580+-0.4715    ?    57.1588+-0.5672         57.0066+-0.2280         might be 1.0103x faster
   regexp                               128.1274+-0.3222        128.0019+-0.5115    ?   128.2721+-0.2462    ?   128.5260+-0.6347        128.2228+-0.5384       ?
   richards                             199.1724+-0.7754    ^   195.8476+-1.0114    ^   190.0187+-0.3232    !   196.7275+-0.6336    ^   188.2355+-0.4251       ^ definitely 1.0581x faster
   splay                                 97.9270+-1.1804    ?    98.7235+-1.0880         97.4831+-0.9426    ?    98.5006+-1.5933         96.9366+-1.2830         might be 1.0102x faster

   <arithmetic>                         127.1517+-0.3586        126.9154+-0.3545    ^   125.2695+-0.3197    !   126.7386+-0.2765    ^   124.6953+-0.2346       ^ definitely 1.0197x faster
   <geometric> *                        118.2612+-0.3635        118.2608+-0.2901    ^   116.9411+-0.3301    !   118.0658+-0.3419    ^   116.4544+-0.2509       ^ definitely 1.0155x faster
   <harmonic>                           109.2657+-0.3707        109.1960+-0.2281    ^   108.2790+-0.3578    !   109.1428+-0.4214    ^   107.9267+-0.2512       ^ definitely 1.0124x faster

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
Kraken:
   ai-astar                             880.6148+-12.7972   !   906.1368+-11.7692       896.0156+-13.7086   ?   905.4757+-11.8226       904.3783+-11.1674      ? might be 1.0270x slower
   audio-beat-detection                 362.9308+-1.6441    !   372.2457+-0.6992    ^   367.7247+-1.0041    ?   370.1424+-1.8943        367.6248+-0.9356       ! definitely 1.0129x slower
   audio-dft                            362.4437+-2.1194    !   379.0759+-4.5236    ?   384.9385+-13.9151       373.4678+-2.4270        373.3610+-2.0426       ! definitely 1.0301x slower
   audio-fft                            221.4656+-2.2163    !   230.2507+-1.3926        228.5942+-1.0521    ?   229.4650+-0.8347        228.8017+-1.4886       ! definitely 1.0331x slower
   audio-oscillator                     442.5004+-2.9541    ?   444.0440+-2.1604    ?   446.9143+-1.2731    ?   448.2512+-0.3485    ^   444.3639+-1.3877       ?
   imaging-darkroom                     390.6533+-3.9529    ?   392.0656+-4.5620    ?   394.7572+-6.0405        392.7188+-4.4128    ?   394.1471+-5.5175       ?
   imaging-desaturate                   297.3018+-0.1087    ^   294.8100+-0.2863    ?   294.8254+-0.3140        294.4904+-0.1848    ?   294.5375+-0.0923       ^ definitely 1.0094x faster
   imaging-gaussian-blur                707.3692+-1.1520    !   710.4705+-0.2606    ^   679.8328+-0.2574    ^   675.6540+-2.1083    ^   634.5286+-0.2616       ^ definitely 1.1148x faster
   json-parse-financial                  72.9227+-0.1522    !    73.7200+-0.2984    ^    73.0223+-0.1088    !    73.4573+-0.1337    ^    72.9119+-0.1311       
   json-stringify-tinderbox             105.5578+-0.2330    ^   104.7458+-0.3328    ?   105.1568+-0.4491    !   105.9152+-0.2104    ^   104.7347+-0.2667       ^ definitely 1.0079x faster
   stanford-crypto-aes                  140.8352+-0.7852    !   142.7918+-0.6504    ^   141.5115+-0.3832        141.4848+-0.3071    ^   136.1049+-0.4451       ^ definitely 1.0348x faster
   stanford-crypto-ccm                  129.3894+-0.9540    ?   129.4925+-0.7512    ?   130.0417+-0.8278        129.0663+-0.5714        128.5332+-0.7245       
   stanford-crypto-pbkdf2               258.6867+-0.7849    !   262.3942+-0.9063        261.9568+-0.9735        260.4793+-1.8295    ?   262.3711+-0.9862       ! definitely 1.0142x slower
   stanford-crypto-sha256-iterative     109.3257+-0.2923    ^   108.8398+-0.1794    ?   108.9560+-0.1795    ^   108.1522+-0.2095    !   108.7162+-0.0966       ^ definitely 1.0056x faster

   <arithmetic> *                       320.1426+-1.0226    !   325.0774+-1.1517        322.4463+-1.8152        322.0158+-0.9001    ^   318.2225+-0.9515         might be 1.0060x faster
   <geometric>                          249.8654+-0.5249    !   252.8872+-0.6022        251.8366+-0.9787        251.3837+-0.3926    ^   249.0942+-0.4430         might be 1.0031x faster
   <harmonic>                           195.0001+-0.3482    !   196.5926+-0.3823        196.0585+-0.4740        195.9323+-0.2409    ^   194.3454+-0.2685       ^ definitely 1.0034x faster

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
All benchmarks:
   <arithmetic>                         118.4966+-0.3424    !   119.9653+-0.3838    ^   118.9116+-0.5723    ?   119.0196+-0.2897    ^   117.5731+-0.2869       ^ definitely 1.0079x faster
   <geometric>                           28.9081+-0.0486    !    29.1105+-0.0486    ^    28.9505+-0.0621    ?    29.0437+-0.0437    ^    28.8784+-0.0452         might be 1.0010x faster
   <harmonic>                             8.5534+-0.0283    ?     8.5880+-0.0292          8.5589+-0.0272    ?     8.5957+-0.0275          8.5744+-0.0244       ? might be 1.0025x slower

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
Geomean of preferred means:
   <scaled-result>                       65.9831+-0.1332    !    66.4985+-0.1266    ^    65.9412+-0.1824    ?    66.2139+-0.1081    ^    65.5878+-0.1008       ^ definitely 1.0060x faster

Running locally...
940/940                                                             
Generating benchmark report at TipOfTree32_Control_EagerCell32_EagerInt32_EagerIntCell32_SunSpiderV8Kraken_nitroflex_20111218_2355_benchReport.txt

Benchmark report for SunSpider, V8, and Kraken on nitroflex (MacBookPro8,2).

VMs tested:
"TipOfTree32" at /Volumes/Data/pizlo/quinary/OpenSource/WebKitBuild/Release/jsc (r103205)
"Control" at /Volumes/Data/pizlo/quartary/OpenSource/Control/Release/jsc
"EagerCell32" at /Volumes/Data/pizlo/quartary/OpenSource/JustCell/Release/jsc
"EagerInt32" at /Volumes/Data/pizlo/quartary/OpenSource/JustInt32/Release/jsc
"EagerIntCell32" at /Volumes/Data/pizlo/quartary/OpenSource/BothIntAndCell/Release/jsc

Collected 12 samples per benchmark/VM, with 4 VM invocations per benchmark. Emitted a call to gc() between sample measurements. Used 1 benchmark iteration per VM invocation for warm-up.
Used the jsc-specific preciseTime() function to get microsecond-level timing. Reporting benchmark execution times with 95% confidence intervals in milliseconds.

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
SunSpider:
   3d-cube                                6.4104+-0.1231          6.3505+-0.1075    ?     6.4139+-0.1256    !     7.0205+-0.2079    ?     7.0465+-0.1567       ! definitely 1.0992x slower
   3d-morph                              10.4546+-0.1152    ?    10.4982+-0.1202         10.3417+-0.1172         10.3279+-0.1231    ?    10.5007+-0.1892       ?
   3d-raytrace                            9.0360+-0.1643    ?     9.2728+-0.1127          9.1758+-0.1889    ?     9.3233+-0.1397          9.2467+-0.1695       ? might be 1.0233x slower
   access-binary-trees                    1.7591+-0.0429          1.7584+-0.0594    ?     1.8367+-0.0662          1.8035+-0.0626          1.7511+-0.0688       
   access-fannkuch                        7.9441+-0.1221          7.9358+-0.1260    ?     8.0134+-0.2004    ^     7.2167+-0.1640          7.2123+-0.0879       ^ definitely 1.1015x faster
   access-nbody                           5.1472+-0.0824          5.1218+-0.0692    ?     5.1638+-0.1247    ?     5.1928+-0.1411          5.1364+-0.1069       
   access-nsieve                          2.6321+-0.1027          2.5682+-0.0285    ?     2.5991+-0.0545          2.5962+-0.0562          2.5394+-0.0579         might be 1.0365x faster
   bitops-3bit-bits-in-byte               1.2495+-0.0252          1.2477+-0.0181          1.2257+-0.0113    ?     1.2360+-0.0227    ?     1.2598+-0.0184       ?
   bitops-bits-in-byte                    2.5014+-0.0579          2.4583+-0.0427          2.4352+-0.0459    ?     2.4598+-0.0674    ?     2.4795+-0.0384       
   bitops-bitwise-and                     2.9107+-0.1010          2.9073+-0.1379          2.8634+-0.1073          2.8327+-0.0467    ?     2.8426+-0.0634         might be 1.0240x faster
   bitops-nsieve-bits                     6.2201+-0.1208          6.2187+-0.0899          6.1906+-0.0908    ?     6.2118+-0.1077    ?     6.2192+-0.0934       
   controlflow-recursive                  2.5673+-0.0767          2.4950+-0.0208    ?     2.5600+-0.0610          2.5389+-0.0723          2.5123+-0.0505         might be 1.0219x faster
   crypto-aes                             9.1697+-0.1886    ?     9.4295+-0.2061    ?     9.5290+-0.2423          9.3429+-0.1416          9.2343+-0.1390       ?
   crypto-md5                             3.0401+-0.0476    ?     3.0584+-0.0800          2.9920+-0.0314    ?     3.0592+-0.0749    ?     3.0932+-0.0606       ? might be 1.0175x slower
   crypto-sha1                            2.6255+-0.0640    ?     2.6269+-0.0628    ?     2.6511+-0.0674          2.6098+-0.0576    ?     2.6545+-0.0639       ? might be 1.0110x slower
   date-format-tofte                     10.5346+-0.1895    ?    10.7255+-0.2408         10.3967+-0.2209    ?    10.4906+-0.2061         10.3866+-0.1450         might be 1.0143x faster
   date-format-xparb                     10.3493+-0.1865    ?    10.6695+-0.1691         10.4856+-0.1663    ?    10.6404+-0.1677         10.6214+-0.1396       ? might be 1.0263x slower
   math-cordic                            8.0954+-0.1329    ?     8.2461+-0.1455          8.2011+-0.1725    ?     8.2306+-0.1457          8.1095+-0.1297       ?
   math-partial-sums                      9.6747+-0.0885          9.6096+-0.1299    ?     9.6969+-0.0992          9.5852+-0.1190    ?     9.6806+-0.1586       ?
   math-spectral-norm                     2.4490+-0.0484          2.4450+-0.0529    ?     2.4867+-0.0569          2.4298+-0.0400    ?     2.4770+-0.0656       ? might be 1.0114x slower
   regexp-dna                             7.8521+-0.1199          7.8351+-0.1262          7.7878+-0.1509    ?     7.8017+-0.1561          7.7988+-0.1381       
   string-base64                          4.6926+-0.1060          4.6310+-0.1113          4.5592+-0.0739    ?     4.6468+-0.0778          4.5966+-0.0772         might be 1.0209x faster
   string-fasta                           7.8367+-0.0985          7.8007+-0.1785    ?     7.8164+-0.1366          7.7325+-0.1282    ?     7.8640+-0.0933       ?
   string-tagcloud                       12.1545+-0.1240         12.0978+-0.1512    ?    12.1237+-0.2274    ?    12.1465+-0.2067    ?    12.2816+-0.1880       ? might be 1.0105x slower
   string-unpack-code                    20.1048+-0.2687         20.0421+-0.3187    ?    20.1430+-0.3510    ?    20.4882+-0.3264         20.0934+-0.2572       
   string-validate-input                  5.9741+-0.0719    ?     6.0267+-0.1616    ?     6.0685+-0.1120          5.9897+-0.1002          5.9735+-0.1277       

   <arithmetic> *                         6.6687+-0.0240    ?     6.6953+-0.0199          6.6830+-0.0250    ?     6.6905+-0.0307          6.6774+-0.0232       ? might be 1.0013x slower
   <geometric>                            5.3923+-0.0196    ?     5.3953+-0.0187    ?     5.3954+-0.0232          5.3923+-0.0248          5.3891+-0.0197         might be 1.0006x faster
   <harmonic>                             4.2312+-0.0196          4.2169+-0.0126    ?     4.2268+-0.0222          4.2196+-0.0272    ?     4.2222+-0.0203         might be 1.0021x faster

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
V8:
   crypto                                93.4784+-0.5292    !    94.6049+-0.3459         94.4066+-0.4868    ?    94.5687+-0.5358    ?    94.9714+-0.7257       ! definitely 1.0160x slower
   deltablue                            155.2772+-1.5120    ^   152.2730+-1.2905        152.1816+-1.2467    ?   153.5283+-0.7856        152.0033+-0.7937       ^ definitely 1.0215x faster
   earley-boyer                          93.9103+-1.2120         93.5373+-1.0239    ?    93.8629+-1.2893    ?    94.5170+-1.2174         94.2256+-0.8840       ?
   raytrace                              51.1711+-0.6247    ^    50.2942+-0.2340    ?    50.5278+-0.6070    ?    50.6960+-0.3244         50.6255+-0.1931         might be 1.0108x faster
   regexp                               111.1767+-0.5652    ^   109.1298+-0.8509    ?   109.3605+-0.6692        108.6833+-0.3919    ?   108.7188+-0.3962       ^ definitely 1.0226x faster
   richards                             165.9538+-0.8707    !   173.3490+-1.2449    ^   158.3445+-0.8386    !   172.8805+-4.7030    ^   160.1457+-0.5755       ^ definitely 1.0363x faster
   splay                                 81.0846+-0.9747         79.8193+-0.8028         79.2714+-1.1735    ?    79.8967+-1.3258    ?    80.0909+-1.0824         might be 1.0124x faster

   <arithmetic>                         107.4360+-0.4372    ?   107.5725+-0.3611    ^   105.4222+-0.4171    !   107.8244+-0.5633    ^   105.8259+-0.2164       ^ definitely 1.0152x faster
   <geometric> *                        100.6017+-0.4039        100.3236+-0.2699    ^    99.0404+-0.4365    !   100.6028+-0.3806    ^    99.4166+-0.2359       ^ definitely 1.0119x faster
   <harmonic>                            93.7125+-0.3870    ^    93.1087+-0.2108         92.4729+-0.4938    !    93.4360+-0.3178    ^    92.8245+-0.2492       ^ definitely 1.0096x faster

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
Kraken:
   ai-astar                             518.0430+-1.6608    !   525.3043+-3.8011        520.8354+-3.4209    !   530.7008+-4.1921    ^   522.2562+-2.4223       ! definitely 1.0081x slower
   audio-beat-detection                 334.1178+-5.5589        333.8456+-2.6174        333.4571+-2.6114    ?   338.4258+-4.6768        333.7522+-3.0316       
   audio-dft                            365.3155+-1.9669    !   374.4020+-3.0752        370.4879+-2.4048    ?   371.7341+-2.3167    ?   375.3137+-2.8792       ! definitely 1.0274x slower
   audio-fft                            206.1603+-1.5394        205.7070+-1.5650    ?   206.7274+-1.2944        205.3574+-1.3025        204.3784+-1.3446       
   audio-oscillator                     407.5070+-1.7803    ?   408.9469+-4.2851        405.8613+-1.5724    !   411.3578+-2.7442        410.6352+-2.5634       ?
   imaging-darkroom                     363.4132+-5.2929    ?   363.6127+-4.5668        362.4976+-3.8439    ?   365.6954+-4.6131        364.1873+-3.9078       ?
   imaging-desaturate                   260.7421+-1.0246    ^   256.1613+-1.8201    ?   259.5290+-2.2835        255.8173+-2.0404    ?   256.3989+-2.1410       ^ definitely 1.0169x faster
   imaging-gaussian-blur                588.7003+-1.8735        585.2959+-1.9524    ^   560.6856+-1.1483        559.4814+-2.1562    ^   533.7549+-1.7441       ^ definitely 1.1029x faster
   json-parse-financial                  59.6896+-0.3448    ?    60.1442+-0.2728    !    61.2234+-0.6037    ^    59.9599+-0.3160    !    60.6702+-0.2189       ! definitely 1.0164x slower
   json-stringify-tinderbox              93.6116+-0.2471    ^    90.5894+-0.5698    ?    91.3488+-0.3312    !    95.3006+-2.7878    ^    91.0553+-0.6099       ^ definitely 1.0281x faster
   stanford-crypto-aes                  110.7881+-0.4250    !   113.3372+-0.7748        112.0772+-1.0780    ?   112.7255+-1.7426    ^   108.8021+-1.1810       ^ definitely 1.0183x faster
   stanford-crypto-ccm                  111.0401+-0.3233        110.4078+-0.6527    ?   110.8787+-0.7203    ?   111.4420+-0.6344        110.5722+-0.4726       
   stanford-crypto-pbkdf2               214.4449+-0.3849    !   219.0484+-1.3740        217.6288+-1.2296        217.5273+-1.0197    ?   218.8864+-0.7426       ! definitely 1.0207x slower
   stanford-crypto-sha256-iterative      96.2111+-0.3085    ?    96.6007+-0.4667    ?    97.1668+-0.3190    ^    96.0681+-0.3242    !    97.0534+-0.1120       ! definitely 1.0088x slower

   <arithmetic> *                       266.4132+-0.8696    ?   267.3860+-0.5639    ^   265.0289+-0.5662    !   266.5424+-0.4590    ^   263.4083+-0.4058       ^ definitely 1.0114x faster
   <geometric>                          213.9095+-0.5590    ?   214.4145+-0.4849        213.8460+-0.4593    ?   214.6923+-0.7122    ^   212.6270+-0.2331       ^ definitely 1.0060x faster
   <harmonic>                           167.1017+-0.3194    ?   167.2466+-0.4952    ?   167.8027+-0.4964    ?   168.0507+-0.8484    ^   166.6620+-0.2237         might be 1.0026x faster

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
All benchmarks:
   <arithmetic>                          99.0473+-0.2774    ?    99.3721+-0.1788    ^    98.3429+-0.1920    !    99.1557+-0.2024    ^    97.9172+-0.1320       ^ definitely 1.0115x faster
   <geometric>                           24.9564+-0.0582    ?    24.9712+-0.0452         24.9038+-0.0530    ?    24.9834+-0.0851         24.8596+-0.0476         might be 1.0039x faster
   <harmonic>                             7.4563+-0.0336          7.4313+-0.0216    ?     7.4480+-0.0382          7.4367+-0.0471    ?     7.4398+-0.0348         might be 1.0022x faster

                                           TipOfTree32               Control               EagerCell32              EagerInt32            EagerIntCell32       EagerIntCell32 v. TipOfTree32
Geomean of preferred means:
   <scaled-result>                       56.3287+-0.1336    ?    56.4201+-0.0618    ^    55.9784+-0.0960    !    56.3996+-0.1410    ^    55.9194+-0.0935       ^ definitely 1.0073x faster

[pizlo@nitroflex bencher]

[Eric Seidel (no email)]

Attachment 119751 [details] was posted by a committer and has review+, assigning to Filip Pizlo for commit.