Bug 95980 – Introduce the Chromium Android Release (Tests) bot

• Status: RESOLVED
• Resolution: FIXED
• Component: New Bugs

[Peter Beverloo]

Introduce the Chromium Android Release (Tests) bot

[Peter Beverloo]

Created attachment 162502 [details]
Patch

[Peter Beverloo]

The machine is ready to be attached. Bill or Lucas, I'll also be needing a password to connect the machine to the master. It'll be listed as the second bot in the Chromium category.

[Peter Beverloo]

Some initial numbers running this locally:

The RunChromiumWebKitUnitTests (webkit_unit_tests) and RunUnitTests (TestWebKitAPI) steps will fail, because they haven't been updated yet to support running tests on devices. Support for this will be added next week.

A full layout test cycle, spread over four devices, currently takes slightly more than an hour.

Out of 32291 found tests, 24118 will be ran, 1855 of which fail right now. There are 28 unexpected passes, 15 text failures and 1756 image failures. This *probably* is due to an image color issue, as can be seen in these two images:

http://peter.sh/files/absolute-poition-in-rtl-parent-actual.png
http://peter.sh/files/absolute-poition-in-rtl-parent-expected.png

(trivia: these two are the first renders made for Android using only upstream WebKit and Chromium code, early July.)

Running TestWebKitAPI locally currently has one failure (bug 95748).
Running webkit_unit_tests locally currently crashes because certain files are not available, which will be addressed in the runner code. In our branch it passes 1116 tests, meaning 36 have been disabled. This will of course be addressed :-).

[Adam Barth]

Comment on attachment 162502 [details]
Patch

Cool!

[William Siegrist]

Slave password generated and sent to Peter.

[Peter Beverloo]

(In reply to comment #5)
> Slave password generated and sent to Peter.

Thank you! I'm landing this.

[Peter Beverloo]

Committed r127847: <http://trac.webkit.org/changeset/127847>

[William Siegrist]

Reconfig failed:

+ service buildbot checkconfig
Checking buildbot config: /var/buildbot/master.cfg:792: DeprecationWarning: Passing a BuildStep subclass to factory.addStep is deprecated.  Please pass a BuildStep instance instead.  Support will be dropped in v0.8.7.
  self.addStep(RunEflAPITests)
Configuration Errors:
  builder 'Chromium Android Release (Tests)' uses unknown slaves u'google-android-tests'

[Peter Beverloo]

Sorry about that! Patch uploaded here:
https://bugs.webkit.org/show_bug.cgi?id=96113

[Peter Beverloo]

Fixed in http://trac.webkit.org/changeset/127875