Bug 82290 - test-webkitpy: prepare for better test run output
Summary: test-webkitpy: prepare for better test run output
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Dirk Pranke
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2012-03-26 20:09 PDT by Dirk Pranke
Modified: 2012-03-27 13:23 PDT (History)
4 users (show)

See Also:


Attachments
Patch (10.05 KB, patch)
2012-03-26 20:13 PDT, Dirk Pranke
no flags Details | Formatted Diff | Diff
Patch (14.64 KB, patch)
2012-03-27 11:53 PDT, Dirk Pranke
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Dirk Pranke 2012-03-26 20:09:28 PDT
test-webkitpy: prepare for better test run output
Comment 1 Dirk Pranke 2012-03-26 20:13:01 PDT
Created attachment 133967 [details]
Patch
Comment 2 Dirk Pranke 2012-03-26 20:18:24 PDT
This change is a prelude to me landing logging changes for per-test timing information and a MeteredStream-style form of output. It will also be the basis for implementing parallel testing, if we decide that's worth it.
Comment 3 Adam Barth 2012-03-26 22:49:09 PDT
Comment on attachment 133967 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=133967&action=review

> Tools/Scripts/webkitpy/test/runner.py:68
> +            # FIXME: it's kinda lame that we re-load the test suites for each
> +            # test, and this may slow things down, but this makes implementing
> +            # the logging easy and will also allow us to parallelize nicely.

Have you measured how much this slows us down?
Comment 4 Dirk Pranke 2012-03-27 11:45:57 PDT
(In reply to comment #3)
> (From update of attachment 133967 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=133967&action=review
> 
> > Tools/Scripts/webkitpy/test/runner.py:68
> > +            # FIXME: it's kinda lame that we re-load the test suites for each
> > +            # test, and this may slow things down, but this makes implementing
> > +            # the logging easy and will also allow us to parallelize nicely.
> 
> Have you measured how much this slows us down?

A couple of unscientific tests seem to point to about a half-second slowdown on my mac pro (18.2 seconds -> 18.7). I'm actually a bit surprised that it's noticeable at all, so I'll have to dig into it further to see what the cause of this is, but I think this is well within the noise for now.
Comment 5 Dirk Pranke 2012-03-27 11:46:44 PDT
Also, I notice that this patch doesn't have the unit tests I wrote in it ... will upload those as well and then land.
Comment 6 Dirk Pranke 2012-03-27 11:53:35 PDT
Created attachment 134110 [details]
Patch
Comment 7 Dirk Pranke 2012-03-27 12:16:10 PDT
Committed r112298: <http://trac.webkit.org/changeset/112298>
Comment 8 Eric Seidel (no email) 2012-03-27 13:23:28 PDT
Comment on attachment 134110 [details]
Patch

Cleared review? from attachment 134110 [details] so that this bug does not appear in http://webkit.org/pending-review.  If you would like this patch reviewed, please attach it to a new bug (or re-open this bug before marking it for review again).