Bug 81019 - Please add a way to manually skip some tests in NRWT
Summary: Please add a way to manually skip some tests in NRWT
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Enhancement
Assignee: Dirk Pranke
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2012-03-13 12:06 PDT by Alexey Proskuryakov
Modified: 2012-03-14 11:56 PDT (History)
3 users (show)

See Also:


Attachments
Patch (9.13 KB, patch)
2012-03-13 18:35 PDT, Dirk Pranke
ojan: review+
Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Alexey Proskuryakov 2012-03-13 12:06:04 PDT
With old run-webkit-tests, I could do e.g. "run-webkit-tests -i inspector,http/inspector" to skip some tests.

This is very useful when testing locally. For example, all inspector tests time out on my machine now for whatever mysterious reason, but I'd like to work on other issues first, running all tests except for these.
Comment 1 Dirk Pranke 2012-03-13 12:07:50 PDT
As mentioned on IRC, you can work around this of course by adding lines to the Skipped file or test_expectations.txt, but that's not a great workaround. This is a fine feature request.
Comment 2 Dirk Pranke 2012-03-13 18:35:45 PDT
Created attachment 131768 [details]
Patch
Comment 3 Dirk Pranke 2012-03-13 18:36:40 PDT
Note that '-i inspector' won't work with just this patch because we're not handling directories properly; that's a separate patch since the code is in a different place ...
Comment 4 Dirk Pranke 2012-03-13 18:37:34 PDT
See bug 81067 as well.
Comment 5 Dirk Pranke 2012-03-13 18:52:46 PDT
(In reply to comment #3)
> Note that '-i inspector' won't work with just this patch because we're not handling directories properly; that's a separate patch since the code is in a different place ...

Never mind, this looks like it's user error on my part. Skipping directories will also work. However, if you are using test_expectations and you attempt to skip a directory on the command line and there is a more-specific expectation in the expectations file, that will override the Skip.

This is probably also a bug, but much lower priority.
Comment 6 Ojan Vafai 2012-03-13 19:25:42 PDT
Comment on attachment 131768 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=131768&action=review

> Tools/ChangeLog:14
> +        Note that there is a separate bug that still needs fixing where
> +        directories are not handled properly either by the command line
> +        flag or in Skipped files.

Is this still accurate? Can you point to the bug?
Comment 7 Dirk Pranke 2012-03-14 11:49:24 PDT
(In reply to comment #6)
> (From update of attachment 131768 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=131768&action=review
> 
> > Tools/ChangeLog:14
> > +        Note that there is a separate bug that still needs fixing where
> > +        directories are not handled properly either by the command line
> > +        flag or in Skipped files.
> 
> Is this still accurate? Can you point to the bug?

No, this is no longer accurate; I will remove it from the ChangeLog.
Comment 8 Dirk Pranke 2012-03-14 11:56:08 PDT
Committed r110724: <http://trac.webkit.org/changeset/110724>