Bug 184920 - Added Support for a Build Binaries Fetcher in Run WebKit Tests via a new flag `--download-binaries`
Summary: Added Support for a Build Binaries Fetcher in Run WebKit Tests via a new flag...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2018-04-24 11:23 PDT by Amal Hussein
Modified: 2018-04-26 15:13 PDT (History)
10 users (show)

See Also:


Attachments
Patch (11.76 KB, patch)
2018-04-24 11:27 PDT, Amal Hussein
ap: review-
Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Amal Hussein 2018-04-24 11:23:21 PDT
Added a Build Binaries Fetcher in Run WebKit Tests via a new flag `--download-binaries`
Comment 1 Amal Hussein 2018-04-24 11:27:48 PDT
Created attachment 338656 [details]
Patch
Comment 2 Amal Hussein 2018-04-24 11:30:17 PDT
unit tests are coming - I still need to make some changes to them.
Comment 3 Alexey Proskuryakov 2018-04-25 22:08:02 PDT
Comment on attachment 338656 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=338656&action=review

> Tools/ChangeLog:3
> +        Added a Build Binaries Fetcher in Run WebKit Tests via a new flag `--download-binaries`

What is the rationale for having this feature? Having many ways to achieve the same result is not great, as it increases potential for confusion.
Comment 4 Jonathan Bedard 2018-04-26 09:00:24 PDT
I would prefer if we just made download-built-product (or a script like it) fit for human usage and move it to scripts.
Comment 5 Amal Hussein 2018-04-26 09:31:04 PDT
(In reply to Jonathan Bedard from comment #4)
> I would prefer if we just made download-built-product (or a script like it)
> fit for human usage and move it to scripts.

Thanks for the feedback Jonathan. Your suggestion of moving this to a standalone script under Tools/Scripts makes sense. 

There is value in integrating the script with the test runner via a flag, so I assume that hook would stay there but reference the renamed standalone script.

Is that also what you were thinking?
Comment 6 Alexey Proskuryakov 2018-04-26 10:31:09 PDT
No, the suggestion is not not have the feature exposed through run-webkit-tests at all. You say that there is value in integrating support, but what is this value? Do you also intend to add such support to run-javascriptcore-tests, run-api-tests, and to other test scripts?
Comment 7 youenn fablet 2018-04-26 10:38:56 PDT
(In reply to Alexey Proskuryakov from comment #6)
> No, the suggestion is not not have the feature exposed through
> run-webkit-tests at all. You say that there is value in integrating support,
> but what is this value? Do you also intend to add such support to
> run-javascriptcore-tests, run-api-tests, and to other test scripts?

That is indeed something that we could consider.
The fact that this is encapsulated in BuildBinariesFetcher should help that.

We need BuildBinariesFetcher to easily rebase WPT tests.
For this specific purpose, there is no hard requirement to add it to run-webkit-tests since we need to do other stuff before and after.

I believe though that this would be a handy option for users of run-webkit-tests.
Comment 8 Alexey Proskuryakov 2018-04-26 10:49:42 PDT
Comment on attachment 338656 [details]
Patch

I think that I'm going to say r- at this point. It doesn't sound like there is any huge reason to create a toaster/fridge combo here.
Comment 9 Amal Hussein 2018-04-26 10:59:52 PDT
(In reply to Alexey Proskuryakov from comment #8)
> Comment on attachment 338656 [details]
> Patch
> 
> I think that I'm going to say r- at this point. It doesn't sound like there
> is any huge reason to create a toaster/fridge combo here.

Alexey - can you elaborate on your points of concern?
Comment 10 Amal Hussein 2018-04-26 13:56:18 PDT
Will be moving this to a standalone script here https://bugs.webkit.org/show_bug.cgi?id=185045
Comment 11 Alexey Proskuryakov 2018-04-26 15:13:38 PDT
> Alexey - can you elaborate on your points of concern?

I think that I already did.