Bug 72879 - [GTK] Add a way to skip unit tests in the bots
Summary: [GTK] Add a way to skip unit tests in the bots
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: PC Linux
: P2 Normal
Assignee: Nobody
URL:
Keywords: Gtk
Depends on:
Blocks:
 
Reported: 2011-11-21 06:51 PST by Carlos Garcia Campos
Modified: 2011-11-21 11:12 PST (History)
2 users (show)

See Also:


Attachments
Patch (4.65 KB, patch)
2011-11-21 06:56 PST, Carlos Garcia Campos
pnormand: review+
Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Carlos Garcia Campos 2011-11-21 06:51:56 PST
testdownload is currently failing in the bots, but not for us, it would be great to be able to skip tests in the bots. It would be even better to be able to skip paths of the tests, but gtester doesn't implement it, so we need to skip full tests for now.
Comment 1 Carlos Garcia Campos 2011-11-21 06:56:58 PST
Created attachment 116078 [details]
Patch

I've rewritten the whole script in python to make it easier to modify for everybody. Last time we had to change this script we already agreed with kov to port it to python, but we didn't do it in the end.
Comment 2 Philippe Normand 2011-11-21 07:28:47 PST
Comment on attachment 116078 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=116078&action=review

Looks good, thanks! Just a little nit to fix before landing.

> Tools/Scripts/run-gtk-tests:79
> +        raise

I don't think this works, raise needs a following exception, you should use the traceback module:

import traceback
traceback.print_exc()
Comment 3 Carlos Garcia Campos 2011-11-21 08:10:12 PST
(In reply to comment #2)
> (From update of attachment 116078 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=116078&action=review
> 
> Looks good, thanks! Just a little nit to fix before landing.
> 
> > Tools/Scripts/run-gtk-tests:79
> > +        raise
> 
> I don't think this works, raise needs a following exception, you should use the traceback module:
> 
> import traceback
> traceback.print_exc()

that raise was just for debugging, I forgot to remove it before sending the patch.
Comment 4 Carlos Garcia Campos 2011-11-21 08:22:11 PST
Committed r100919: <http://trac.webkit.org/changeset/100919>
Comment 5 Philippe Normand 2011-11-21 10:57:13 PST
Borked our Debug bots!

Traceback (most recent call last):
  File "./Tools/Scripts/run-gtk-tests", line 84, in <module>
    sys.exit(TestRunner().run())
  File "./Tools/Scripts/run-gtk-tests", line 38, in __init__
    for test_file in os.listdir(os.path.join(self._programs_path, test_dir)):
OSError: [Errno 2] No such file or directory: '/home/slave/webkitgtk/gtk-linux-64-debug/build/WebKitBuild/Release/Programs/unittests

That's because we never call set-webkit-configuration it seems. So webkit-build-directory always returns Release.
Comment 6 Philippe Normand 2011-11-21 11:10:28 PST
(In reply to comment #5)
> Borked our Debug bots!
> 
> Traceback (most recent call last):
>   File "./Tools/Scripts/run-gtk-tests", line 84, in <module>
>     sys.exit(TestRunner().run())
>   File "./Tools/Scripts/run-gtk-tests", line 38, in __init__
>     for test_file in os.listdir(os.path.join(self._programs_path, test_dir)):
> OSError: [Errno 2] No such file or directory: '/home/slave/webkitgtk/gtk-linux-64-debug/build/WebKitBuild/Release/Programs/unittests
> 
> That's because we never call set-webkit-configuration it seems. So webkit-build-directory always returns Release.

Landed a temporary workaround http://trac.webkit.org/changeset/100938
Comment 7 Philippe Normand 2011-11-21 11:12:19 PST
See also bug 72902