Bug 95980 - Introduce the Chromium Android Release (Tests) bot
Summary: Introduce the Chromium Android Release (Tests) bot
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Peter Beverloo
URL:
Keywords:
Depends on: 96113
Blocks: 84843 84845
  Show dependency tree / graph
 
Reported: 2012-09-06 07:15 PDT by Peter Beverloo
Modified: 2012-09-11 08:16 PDT (History)
4 users (show)

See Also:

Attachments
Patch (2.49 KB, patch)
2012-09-06 07:17 PDT, Peter Beverloo 		no flags Details | Formatted Diff | Diff
Show Obsolete (1) View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Peter Beverloo 2012-09-06 07:15:38 PDT 
Introduce the Chromium Android Release (Tests) bot
Comment 1 Peter Beverloo 2012-09-06 07:17:26 PDT 
Created attachment 162502 [details]
Patch
Comment 2 Peter Beverloo 2012-09-06 07:18:47 PDT 
The machine is ready to be attached. Bill or Lucas, I'll also be needing a password to connect the machine to the master. It'll be listed as the second bot in the Chromium category.
Comment 3 Peter Beverloo 2012-09-06 08:18:48 PDT 
Some initial numbers running this locally:

The RunChromiumWebKitUnitTests (webkit_unit_tests) and RunUnitTests (TestWebKitAPI) steps will fail, because they haven't been updated yet to support running tests on devices. Support for this will be added next week.

A full layout test cycle, spread over four devices, currently takes slightly more than an hour.

Out of 32291 found tests, 24118 will be ran, 1855 of which fail right now. There are 28 unexpected passes, 15 text failures and 1756 image failures. This *probably* is due to an image color issue, as can be seen in these two images:

http://peter.sh/files/absolute-poition-in-rtl-parent-actual.png
http://peter.sh/files/absolute-poition-in-rtl-parent-expected.png

(trivia: these two are the first renders made for Android using only upstream WebKit and Chromium code, early July.)

Running TestWebKitAPI locally currently has one failure (bug 95748).
Running webkit_unit_tests locally currently crashes because certain files are not available, which will be addressed in the runner code. In our branch it passes 1116 tests, meaning 36 have been disabled. This will of course be addressed :-).
Comment 4 Adam Barth 2012-09-06 09:30:49 PDT 
Comment on attachment 162502 [details]
Patch

Cool!
Comment 5 William Siegrist 2012-09-06 15:19:03 PDT 
Slave password generated and sent to Peter.
Comment 6 Peter Beverloo 2012-09-07 02:13:36 PDT 
(In reply to comment #5)
> Slave password generated and sent to Peter.

Thank you! I'm landing this.
Comment 7 Peter Beverloo 2012-09-07 02:19:44 PDT 
Committed r127847: <http://trac.webkit.org/changeset/127847>
Comment 8 William Siegrist 2012-09-07 08:25:34 PDT 
Reconfig failed:

+ service buildbot checkconfig
Checking buildbot config: /var/buildbot/master.cfg:792: DeprecationWarning: Passing a BuildStep subclass to factory.addStep is deprecated.  Please pass a BuildStep instance instead.  Support will be dropped in v0.8.7.
  self.addStep(RunEflAPITests)
Configuration Errors:
  builder 'Chromium Android Release (Tests)' uses unknown slaves u'google-android-tests'
Comment 9 Peter Beverloo 2012-09-07 08:32:07 PDT 
Sorry about that! Patch uploaded here:
https://bugs.webkit.org/show_bug.cgi?id=96113
Comment 10 Peter Beverloo 2012-09-07 09:06:46 PDT 
Fixed in http://trac.webkit.org/changeset/127875