[Meta] DRT should be able to run Dromaeo

• Component: Tools / Tests
• Status: RESOLVED DUPLICATE

[Hajime Morrita]

This is a tracking bug.

To make performance measurement more easy and automatable,
I'd like to run various existing perf tests on DRT.
I'm particularly interested in Dromaeo  since 
- It has some DOM centric tests, which we have only a few, and
- It is already almost automated so we just need small tweak (I guess).

My current idea is to
- Add small number of APIs and/or command-line options to DRT
- Upstream DRT specific changes to Dromaeo - they already have some spidermonkey-specific calls.
   If we couldn't upstream the change, we can maintain a fork. But my guess is that they are liberal enough.

I'd start from Mac DRT then move to Chromium DRT.

[Hajime Morrita]

I understand that the performance measurement on DRT isn't perfect
because it behaves differently from the real browsers in, for example, painting and event handling.
But even so, this would be nice to have, especially for automation and easy to use.

[Ryosuke Niwa]

What kind of DRT changes do we need to make? Can't we already run Dromaeo if we modified the script a little bit?

[Hajime Morrita]

(In reply to comment #2)
> What kind of DRT changes do we need to make? Can't we already run Dromaeo if we modified the script a little bit?
What I found is that we need 

A. a way to supress timeout watchdog (Chromium already has it IIRC)
B. an alternative for query string to specify the type of test to run. 
    The file URL doesn't support the query string and supporting it looks a bit tricky on Mac.

We don't need B if we can run it via HTTP server. But it would suffer the stability.
So passing something like argument would help.

[Ryosuke Niwa]

(In reply to comment #3)
> A. a way to supress timeout watchdog (Chromium already has it IIRC)

I see. This should probably a layoutTestController/internals feature?

> B. an alternative for query string to specify the type of test to run. 
>     The file URL doesn't support the query string and supporting it looks a bit tricky on Mac.

Really? Query string doesn't work on file URLs?

[Hajime Morrita]

(In reply to comment #4)
> (In reply to comment #3)
> > A. a way to supress timeout watchdog (Chromium already has it IIRC)
> 
> I see. This should probably a layoutTestController/internals feature?

Chromium DRT supports "--no-timeout" commandline option. So I'll follow that way.

> 
> > B. an alternative for query string to specify the type of test to run. 
> >     The file URL doesn't support the query string and supporting it looks a bit tricky on Mac.
> 
> Really? Query string doesn't work on file URLs?

It is a valid URL. But DRT (Mac DRT at least) doesn't handle it as expected.
Because the file path is represented in URL object (in mac, its NSURL) and
handled by the platform stack of each platform, we cannot rely on its edge behavior
assuming  we cannot change them.

Well, providing a direct alternative is just an idea. We can explore another path.
For example, providing a way to extra scripts (like content scripts of chromium extension) 
might be more flexible.

[Hajime Morrita]

Update:

Now I made a small fork of Dromaeo for DRT.
https://github.com/omo/dromaeo
See https://github.com/omo/dromaeo/wiki/Running-on-DRT to try.

I'm investigating how we can integrate this to run-perf-test

[Eric Seidel (no email)]

Doesn't DRT already run Dromaeo as part of run-perf-tests?

[Hajime Morrita]

(In reply to comment #7)
> Doesn't DRT already run Dromaeo as part of run-perf-tests?
Right. this is used for tracking Dromaeo related test bugs
but looks better to be merged to Bug 77037.

*** This bug has been marked as a duplicate of bug 77037 ***