Bug 35843
| Summary: | REGRESSION(r55035): string-base64 20x slower (in-browser only) | ||
|---|---|---|---|
| Product: | WebKit | Reporter: | Joe Strzemp <maccinema> |
| Component: | New Bugs | Assignee: | Nobody <webkit-unassigned> |
| Status: | RESOLVED FIXED | ||
| Severity: | Normal | CC: | barraclough, loki, oliver, sam |
| Priority: | P2 | Keywords: | InRadar, Performance, Regression |
| Version: | 528+ (Nightly build) | ||
| Hardware: | Mac (Intel) | ||
| OS: | OS X 10.6 | ||
| URL: | http://www2.webkit.org/perf/sunspider-0.9/string-base64.html | ||
Joe Strzemp
The SunSpider base64 subtest is running 20x slower since build 55043 (Feb 19) using Safari.
base64: *20.1x as slow* 16.0ms +/- 16.5% 320.8ms +/- 6.3% significant
Oddly, this is the only test that was slower!?!
I first noticed this when I compared a recent nightly build with the most recent Apple version installed on my Mac 10.6.2.
Also, it appears that build 55027 (also Feb 19) was the last build that performs base64 well.
| Attachments | ||
|---|---|---|
| Add attachment proposed patch, testcase, etc. |
Joe Strzemp
Changing URL in bugreport to specific test (string-base64.html) allowing for faster verifying.
Joe Strzemp
http://trac.webkit.org/changeset/55035 looks like probable cause of performance regression with strings-base64 SunSpider test.
Sam Weinig
I can reproduce this in r55636.
Sam Weinig
<rdar://problem/7726437>
Joe Strzemp
In addition...
If this performance drop is only seen "in-browser only", then perhaps a non-browser test that
mimics the browser action needs to be added to the test suite (if not currently skipped).
Seems that a 20x performance drop is not something that should go unnoticed by an
automated test suite.
Gabor Loki
Unfortunately, I can also confirm that this fix (r55035) caused a performance regression on ARM (JSValue32).
See the summarized results at:
http://webkit.sed.hu/benchmark/revision/55032
http://webkit.sed.hu/benchmark/revision/55040
From SunSpider:
** TOTAL **: *1.24x as slow* 7730.2ms +/- 0.3% 9608.5ms +/- 0.4% significant
...
string: *2.07x as slow* 1720.9ms +/- 0.2% 3562.5ms +/- 0.3% significant
base64: *10.1x as slow* 202.1ms +/- 0.7% 2049.5ms +/- 0.4% significant
...
Gavin Barraclough
55035 reverted in 55679, I'll land a new fix for the problem.
(keeping this bug open until the new fix lands).
Gavin Barraclough
Landed new version in r56021.