Bug 184699

Summary: [GTK] Generate a JSC bundle on the 64 and 32 bit release bots and upload it to webkitgtk.org
Product: WebKit Reporter: Carlos Alberto Lopez Perez <clopez>
Component: Tools / TestsAssignee: Carlos Alberto Lopez Perez <clopez>
Status: RESOLVED FIXED    
Severity: Normal CC: aakash_jain, ap, bugs-noreply, clopez, dbates, ews-watchlist, gustavo, lforschler, mathias, ossy, psaavedra, webkit-bug-importer, ysuzuki
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=179945
https://bugs.webkit.org/show_bug.cgi?id=213615
Attachments:
Description Flags
Patch
none
Patch gustavo: review+

Description Carlos Alberto Lopez Perez 2018-04-17 09:54:39 PDT
The developers from the jsvu project <https://github.com/GoogleChromeLabs/jsvu> will like access to the JSC built products the x86_64 and x86_32 WebKitGTK+ (Linux) bots generate daily at http://build.webkit.org/waterfall?category=GTK

More details: https://lists.webkit.org/pipermail/webkit-dev/2017-December/029805.html

In order to provide this JSC bundle, the first idea was to re-use the current built products that the x86_64 bot generates for testing on the test bots.
But there is an issue with this built products, and is that they don't bundle any libraries from JHBuild or the system.

And adding this libraries would cause the size of the bundle to grow significantly, and it will not work in any case for the 32-bit bot as this one doesn't generate a built product at all currently.

So a better idea may be to generate a new bundle specifically for JSC with only the jsc binary and the libraries that links with it.

This bundle can be generated and uploaded in a new step for the GTK release build bots (x86_64 and x86_32 bit)
Comment 1 Carlos Alberto Lopez Perez 2018-04-17 11:08:14 PDT
Created attachment 338131 [details]
Patch
Comment 2 EWS Watchlist 2018-04-17 11:10:51 PDT
Attachment 338131 [details] did not pass style-queue:


ERROR: Tools/BuildSlaveSupport/build.webkit.org-config/factories.py:66:  [BuildFactory.__init__] Undefined variable 'GenerateJSCBundle'  [pylint/E0602] [5]
ERROR: Tools/BuildSlaveSupport/build.webkit.org-config/factories.py:101:  [TestFactory.__init__] Undefined variable 'GenerateJSCBundle'  [pylint/E0602] [5]
Total errors found: 2 in 6 files


If any of these errors are false positives, please file a bug against check-webkit-style.
Comment 3 Carlos Alberto Lopez Perez 2018-04-17 11:13:10 PDT
(In reply to Build Bot from comment #2)
> Attachment 338131 [details] did not pass style-queue:
> 
> 
> ERROR: Tools/BuildSlaveSupport/build.webkit.org-config/factories.py:66: 
> [BuildFactory.__init__] Undefined variable 'GenerateJSCBundle' 
> [pylint/E0602] [5]
> ERROR: Tools/BuildSlaveSupport/build.webkit.org-config/factories.py:101: 
> [TestFactory.__init__] Undefined variable 'GenerateJSCBundle' 
> [pylint/E0602] [5]
> Total errors found: 2 in 6 files
> 
> 
> If any of these errors are false positives, please file a bug against
> check-webkit-style.

BTW, this warnings are incorrect. GenerateJSCBundle() is implemented on steps.py but the tool seems confused with that. I double-checked with the script run-buildbot-test.py that the master starts fine with this config changes and does what is expected.
Comment 4 Carlos Alberto Lopez Perez 2018-04-17 11:50:57 PDT
Created attachment 338136 [details]
Patch

Patch v2, minor cosmetic changes on the script
Comment 5 EWS Watchlist 2018-04-17 11:53:19 PDT
Attachment 338136 [details] did not pass style-queue:


ERROR: Tools/BuildSlaveSupport/build.webkit.org-config/factories.py:66:  [BuildFactory.__init__] Undefined variable 'GenerateJSCBundle'  [pylint/E0602] [5]
ERROR: Tools/BuildSlaveSupport/build.webkit.org-config/factories.py:101:  [TestFactory.__init__] Undefined variable 'GenerateJSCBundle'  [pylint/E0602] [5]
Total errors found: 2 in 6 files


If any of these errors are false positives, please file a bug against check-webkit-style.
Comment 6 Gustavo Noronha (kov) 2018-04-30 10:29:52 PDT
Comment on attachment 338136 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=338136&action=review

LGTM, and I installed the packages and deployed the file in 32bot =) sorry for the delay!

> Tools/Scripts/generate-jsc-bundle:124
> +    # Clean everthing from previous runs

everything*

> Tools/Scripts/generate-jsc-bundle:142
> +    # jsvu project preffers .zip rather than .tar.xz

prefers*

Interesting, I wasn't aware of jsvu =)
Comment 7 Carlos Alberto Lopez Perez 2018-05-02 05:00:47 PDT
Committed r231230: <https://trac.webkit.org/changeset/231230>
Comment 8 Radar WebKit Bug Importer 2018-05-02 05:01:32 PDT
<rdar://problem/39900292>
Comment 9 Carlos Alberto Lopez Perez 2018-05-02 13:08:07 PDT
Committed r231256: <https://trac.webkit.org/changeset/231256>