Bug 97507

Summary:

[Performance Test] Import RoboHornet

Product:

WebKit

Reporter:

Hajime Morrita <morrita>

Component:

Tools / Tests

Assignee:

Nobody <webkit-unassigned>

Status:

NEW ---

Severity:

Normal

CC:

abarth, eae, eric, haraken, komoroske, mjs, rniwa, zoltan

Priority:

Version:

528+ (Nightly build)

Hardware:

Unspecified

OS:

Unspecified

Bug Depends on:

Bug Blocks:

77037

Attachments:

Description	Flags
Patch	none

Description Hajime Morrita 2012-09-24 18:11:11 PDT

A new browser benchmark is released.
- http://www.robohornet.org/

It would be great if we have this as a part of our PerformanceTest
and run it as a perfbot target and performance investigation.

Comment 1 Ryosuke Niwa 2012-09-24 18:19:26 PDT

How does it take to run the tests? FWIW, perf. bots already take ~1 hour to cycle. Maybe we can disable some of existing tests on bots? (e.g. there are multiple floats_* tests).

Comment 2 Hajime Morrita 2012-09-24 19:18:53 PDT

It shouldn't take that long (a few minutes?)
But yes, I think we need to kill some of Dromaeo tests before enabling these.
It already takes so long as you filed as Bug 97285.

Comment 3 Eric Seidel (no email) 2012-10-02 16:24:38 PDT

here is a sketched out "shim" to be able to run unmodified tests.

Currently requires symlinking robohornet/static/tests into PerformanceTests/robohornet/resources/tests

Comment 4 Eric Seidel (no email) 2012-10-02 16:27:55 PDT

Created attachment 166773 [details]
Patch

Comment 5 Eric Seidel (no email) 2012-10-02 16:28:07 PDT

I should have passed --no-assign. :)

Comment 6 Emil A Eklund 2012-10-02 16:35:26 PDT

I would suggest that we hold of importing it for a while as there is a lot of discussion about the test methodology and the implementation of some of the tests. Those discussions are likely to result in changes to the tests that might affect how we run them.

Comment 7 Eric Seidel (no email) 2012-10-10 11:02:31 PDT

bug 98798 tracks perf issues we've found from RoboHornet/RoboHornetPro