Bug 174198 – Enabling uploading archives to S3

• Component: Tools / Tests
• Status: RESOLVED FIXED

[Lucas Forschler]

Teach buildbot to use S3 for archive storage.

[Radar WebKit Bug Importer]

<rdar://problem/33152999>

[Lucas Forschler]

Created attachment 314710 [details]
v1 patch for review

[Lucas Forschler]

Created attachment 314753 [details]
v2 patch for review

[Lucas Forschler]

Created attachment 314754 [details]
v3 patch for review

had a search/replace error in the last one.

[Lucas Forschler]

Comment on attachment 314754 [details]
v3 patch for review

View in context: https://bugs.webkit.org/attachment.cgi?id=314754&action=review

> Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:790
> +    haltOnFailure = True

This should be transferring and transferred

[Kocsen Chung]

Comment on attachment 314754 [details]
v3 patch for review

View in context: https://bugs.webkit.org/attachment.cgi?id=314754&action=review

> Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:265
> +class ArchiveMinifiedBuiltProduct(ArchiveBuiltProduct):

Nit: ArchiveMinifiedBuildProduct
(Build instead of Built)

> Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:294
> +    

Nit: add extra whitespace for a total of two newlines between class bodies.

> Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:787
> +    name = "transfer-to-s3"

I think it would be nice to adhere to other steps when it comes to the order of these variables.

Usually (from immediate context above) I see name, description,  descriptionDone and command declared first and succeed in that order.
The rest can go below those.

[Lucas Forschler]

Comment on attachment 314754 [details]
v3 patch for review

View in context: https://bugs.webkit.org/attachment.cgi?id=314754&action=review

>> Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:265
>> +class ArchiveMinifiedBuiltProduct(ArchiveBuiltProduct):
> 
> Nit: ArchiveMinifiedBuildProduct
> (Build instead of Built)

I'm following the convention of the parent class, which is "ArchiveBuiltProduct".
I think we should stay consistent here.

>> Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:294
>> +    
> 
> Nit: add extra whitespace for a total of two newlines between class bodies.

I went back and forth on this... this file is NOT consistent... about half of the classes have one space, there other two between them.
Let's do a follow-up patch which adds two spaces everywhere.

>> Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:787
>> +    name = "transfer-to-s3"
> 
> I think it would be nice to adhere to other steps when it comes to the order of these variables.
> 
> Usually (from immediate context above) I see name, description,  descriptionDone and command declared first and succeed in that order.
> The rest can go below those.

sounds reasonable.

[Lucas Forschler]

Created attachment 314759 [details]
v4 patch with feedback applied

[WebKit Commit Bot]

Comment on attachment 314759 [details]
v4 patch with feedback applied

Rejecting attachment 314759 [details] from commit-queue.

Failed to run "['/Volumes/Data/EWS/WebKit/Tools/Scripts/webkit-patch', '--status-host=webkit-queues.webkit.org', '--bot-id=webkit-cq-01', 'land-attachment', '--force-clean', '--non-interactive', '--parent-command=commit-queue', 314759, '--port=mac']" exit_code: 2 cwd: /Volumes/Data/EWS/WebKit

Last 500 characters of output:
.webkit.org/git/WebKit
   f7690be..bffe022  master     -> origin/master
Partial-rebuilding .git/svn/refs/remotes/origin/master/.rev_map.268f45cc-cd09-0410-ab3c-d52691b4dbfc ...
Currently at 219228 = f7690bed686173d0f489bfe42db410ad8803373f
r219229 = bffe0225c245062649b98d0475077cff818f4b6b
Done rebuilding .git/svn/refs/remotes/origin/master/.rev_map.268f45cc-cd09-0410-ab3c-d52691b4dbfc
First, rewinding head to replay your work on top of it...
Fast-forwarded master to refs/remotes/origin/master.

Full output: http://webkit-queues.webkit.org/results/4066537

[Lucas Forschler]

Created attachment 314804 [details]
patch for landing

[WebKit Commit Bot]

Comment on attachment 314804 [details]
patch for landing

Clearing flags on attachment: 314804

Committed r219235: <http://trac.webkit.org/changeset/219235>

[WebKit Commit Bot]

All reviewed patches have been landed.  Closing bug.

[Csaba Osztrogonác]

(In reply to WebKit Commit Bot from comment #11)
> Comment on attachment 314804 [details]
> patch for landing
> 
> Clearing flags on attachment: 314804
> 
> Committed r219235: <http://trac.webkit.org/changeset/219235>

It broke the mastercfg_unittest.py build step list test, please update it.

[Csaba Osztrogonác]

unit test fix landed in https://trac.webkit.org/changeset/220125/webkit