Bug 110069 - GCE EWS bots are all offline
Summary: GCE EWS bots are all offline
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Alan Cutter
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2013-02-17 19:08 PST by Alan Cutter
Modified: 2013-02-17 23:46 PST (History)
5 users (show)

See Also:


Attachments
Patch (8.68 KB, patch)
2013-02-17 22:14 PST, Alan Cutter
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Alan Cutter 2013-02-17 19:08:01 PST
All the GCE bots were terminated over the weekend.
Bots affected:
 - commit-queue
 - cr-linux-ews/chromium-ews
 - cr-linux-debug-ews
 - style-queue
 - feeder-queue
 - sheriffbot

The problem is the image we were using (ubuntu-10-04-v20120621) was obsoleted.
CE recommends using gcel-10-04-v20130104 instead.

The hard coded /dev/vdb no longer exists, we should be using /dev/ephemeral-disk-0 to access the ephemeral disk.
Comment 1 Alan Cutter 2013-02-17 21:56:18 PST
A partition on /dev/ephemeral-disk-0 is created as /dev/ephemeral-disk-0-part1.
These are soft links to /dev/sdb and /dev/sdb1 respectively.
The soft links are not always created in time for the script to use them and it fails to create a fs or mount it. This happened in 12/15 cases.
With this is mind it is better to use /dev/sdb and /dev/sdb1 directly. If the image changes again in future this will be a thing to lookout for in case it differs again.

Another difference on this image is that /etc/hosts doesn't have general read access thus things are unable to connect to localhost. This breaks the DRT tests.
Will need to "sudo chmod 644 /etc/hosts" as part of the VM build.
Comment 2 Alan Cutter 2013-02-17 22:14:38 PST
Created attachment 188797 [details]
Patch
Comment 3 Eric Seidel (no email) 2013-02-17 22:16:56 PST
Comment on attachment 188797 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=188797&action=review

Looks reasonable.

> Tools/EWSTools/build-vm.sh:61
> +sudo chmod 644 /etc/hosts

?!?
Comment 4 Alan Cutter 2013-02-17 22:23:04 PST
(In reply to comment #3)
> (From update of attachment 188797 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=188797&action=review
> 
> Looks reasonable.
> 
> > Tools/EWSTools/build-vm.sh:61
> > +sudo chmod 644 /etc/hosts
> 
> ?!?

Haha, I too am perplexed that it needed this. It was 640 by default meaning you couldn't ping localhost!
Comment 5 Eric Seidel (no email) 2013-02-17 22:24:45 PST
Comment on attachment 188797 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=188797&action=review

>>> Tools/EWSTools/build-vm.sh:61
>>> +sudo chmod 644 /etc/hosts
>> 
>> ?!?
> 
> Haha, I too am perplexed that it needed this. It was 640 by default meaning you couldn't ping localhost!

!?  That sounds like a config error in the default image?

I wonder if it warrants a GCE bug.
Comment 6 WebKit Review Bot 2013-02-17 23:46:07 PST
Comment on attachment 188797 [details]
Patch

Clearing flags on attachment: 188797

Committed r143156: <http://trac.webkit.org/changeset/143156>
Comment 7 WebKit Review Bot 2013-02-17 23:46:11 PST
All reviewed patches have been landed.  Closing bug.