Bug 97507 - [Performance Test] Import RoboHornet
Summary: [Performance Test] Import RoboHornet
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks: 77037
  Show dependency treegraph
 
Reported: 2012-09-24 18:11 PDT by Hajime Morrita
Modified: 2017-07-18 08:27 PDT (History)
8 users (show)

See Also:


Attachments
Patch (4.10 KB, patch)
2012-10-02 16:27 PDT, Eric Seidel (no email)
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Hajime Morrita 2012-09-24 18:11:11 PDT
A new browser benchmark is released.
- http://www.robohornet.org/

It would be great if we have this as a part of our PerformanceTest
and run it as a perfbot target and performance investigation.
Comment 1 Ryosuke Niwa 2012-09-24 18:19:26 PDT
How does it take to run the tests? FWIW, perf. bots already take ~1 hour to cycle. Maybe we can disable some of existing tests on bots? (e.g. there are multiple floats_* tests).
Comment 2 Hajime Morrita 2012-09-24 19:18:53 PDT
It shouldn't take that long (a few minutes?)
But yes, I think we need to kill some of Dromaeo tests before enabling these.
It already takes so long as you filed as Bug 97285.
Comment 3 Eric Seidel (no email) 2012-10-02 16:24:38 PDT
here is a sketched out "shim" to be able to run unmodified tests.

Currently requires symlinking robohornet/static/tests into PerformanceTests/robohornet/resources/tests
Comment 4 Eric Seidel (no email) 2012-10-02 16:27:55 PDT
Created attachment 166773 [details]
Patch
Comment 5 Eric Seidel (no email) 2012-10-02 16:28:07 PDT
I should have passed --no-assign. :)
Comment 6 Emil A Eklund 2012-10-02 16:35:26 PDT
I would suggest that we hold of importing it for a while as there is a lot of discussion about the test methodology and the implementation of some of the tests. Those discussions are likely to result in changes to the tests that might affect how we run them.
Comment 7 Eric Seidel (no email) 2012-10-10 11:02:31 PDT
bug 98798 tracks perf issues we've found from RoboHornet/RoboHornetPro