Bug 10265

Summary: SVG needs a Page Load Test (PLT)
Product: WebKit Reporter: Eric Seidel (no email) <eric>
Component: SVGAssignee: Eric Seidel (no email) <eric>
Severity: Normal Keywords: SVGHitList
Priority: P2    
Version: 420+   
Hardware: Mac   
OS: OS X 10.4   
Bug Depends on:    
Bug Blocks: 6010    
Description Flags
patch including just the support files beidson: review+

Description Eric Seidel (no email) 2006-08-05 01:33:18 PDT
SVG needs a PLT

This would not be super hard to do.  All this would require is someone sitting down with some public domain SVG files (like http://www.openclipart.com/) for a while and finding 50 or so "representative" files (some large, some small, hopefully covering most of the features of SVG.

To make a plt file just means make a new text file named "mytest.pltsuite" with a bunch of urls in it (preferably file://) and adding it into the Safari.app resources folder.

Then under the debug menu, you'll see a "Show Page Load Test Window" menu item.  Open that to run your newly created PLT file.

We just need an arbitrary PLT file so that we can start to keep performance numbers for SVG as we continue to change things.
Comment 1 Eric Seidel (no email) 2006-08-05 01:37:58 PDT
Another option would be to have a PLT for SVG which just used the w3c test files.  That's probably easiest to begin with.  "real world" SVGs are probably more representative however.

It would even be fine to include animation (script or declarative) which would need to run to completion.  fixed-length animations will increase the length of running the tests, but will not decrease their accuracy.

One further obstacle which will need to be overcome is how to install the plt suite properly on any machine.  Internally I wrote a little sed script to do that, however that script has not yet made its way into the public repository yet.

Eventually it would be nice to get all of the safari performance testing scripts into the public repository.  That just hasn't happened yet (and since I've left we'll have to convince a current safari team member to do so).
Comment 2 Eric Seidel (no email) 2006-08-05 01:42:06 PDT
bug 10266 talks about moving more internal performance testing scripts into the public webkit repository.
Comment 3 Eric Seidel (no email) 2006-08-12 03:50:50 PDT
An example pltsuite file was attached to 6010.
Comment 4 Eric Seidel (no email) 2006-12-26 16:16:44 PST
Created attachment 12049 [details]
patch including just the support files

Merry Christmas, WebKit. :)
Comment 5 Brady Eidson 2006-12-26 16:23:59 PST
Comment on attachment 12049 [details]
patch including just the support files

r=me with two comments
1 - In principle, this looks great but as far as being a "representative set of svgs" I can't really say - perhaps olliej or hyatt can better judge that
2 - I'd like to see a wait 30 after the first test then wait 10's for the cached runs.  This is as opposed to the wait 10 and wait 5's I see here
Comment 6 Eric Seidel (no email) 2006-12-26 16:36:28 PST
I'm not sure the numbers are correct.  (PLT may not work for XML correctly, not sure.) Autovicki still will need to be made available (something better than the silly run-pageloadtest I hacked together).  Also, we might want to revise the set of SVGs we use.  Once we get things working, a blog post announcing the test and asking for submissions could be useful.

Landed as r18427.
Comment 7 Eric Seidel (no email) 2006-12-26 17:12:32 PST
*** Bug 5038 has been marked as a duplicate of this bug. ***