Bug 174445 - Add WebDriver support in browser driver part of BenchmarkRunner
Summary: Add WebDriver support in browser driver part of BenchmarkRunner
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on: 175126
Blocks: 174056 174331
  Show dependency treegraph
 
Reported: 2017-07-12 17:22 PDT by Matthew Stewart
Modified: 2017-08-03 04:32 PDT (History)
5 users (show)

See Also:


Attachments
Patch (17.49 KB, patch)
2017-07-12 17:36 PDT, Matthew Stewart
no flags Details | Formatted Diff | Diff
Archive of layout-test-results from ews124 for ios-simulator-wk2 (11.35 MB, application/zip)
2017-07-12 19:40 PDT, Build Bot
no flags Details
Patch (17.92 KB, patch)
2017-07-17 15:02 PDT, Matthew Stewart
no flags Details | Formatted Diff | Diff
Patch (18.08 KB, patch)
2017-07-17 16:37 PDT, Matthew Stewart
no flags Details | Formatted Diff | Diff
Patch (18.15 KB, patch)
2017-07-19 13:56 PDT, Matthew Stewart
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Matthew Stewart 2017-07-12 17:22:03 PDT
Add WebDriver support in browser driver part of BenchmarkRunner
Comment 1 Matthew Stewart 2017-07-12 17:36:23 PDT
Created attachment 315317 [details]
Patch
Comment 2 Stephanie Lewis 2017-07-12 17:58:00 PDT
Comment on attachment 315317 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=315317&action=review

> Tools/Scripts/webkitpy/benchmark_runner/browser_driver/osx_chrome_driver.py:29
> +        args.insert(2, url)

This feels clunky.  Given this code is duplicated below I think it worth having helper function just to give it a name like insert_url_into_arguments.  Also rather than changing the args array itself I'd make a new array so we don't have to worry about the constants being in a bad state.

> Tools/Scripts/webkitpy/benchmark_runner/browser_driver/osx_firefox_driver.py:25
> +        args.insert(0, url)

ditto.  Your insert function should probably take a pos and return the new args array and can be used in both places.
Comment 3 Build Bot 2017-07-12 19:40:53 PDT
Comment on attachment 315317 [details]
Patch

Attachment 315317 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/4110917

New failing tests:
imported/w3c/IndexedDB-private-browsing/idbfactory_open12.html
Comment 4 Build Bot 2017-07-12 19:40:54 PDT
Created attachment 315328 [details]
Archive of layout-test-results from ews124 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews124  Port: ios-simulator-wk2  Platform: Mac OS X 10.12.5
Comment 5 Matthew Stewart 2017-07-17 15:02:24 PDT
Created attachment 315719 [details]
Patch
Comment 6 Stephanie Lewis 2017-07-17 15:34:05 PDT
Comment on attachment 315719 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=315719&action=review

Otherwise patch looks awesome!

> Tools/ChangeLog:8
> +        * Scripts/webkitpy/benchmark_runner/browser_driver/browser_driver.py:

This changelog is long enough that you should have a paragraph under the reviewed bit describing in more detail what it does.  Also some minimal annotation on the various functions to describe their purpose can be useful.
Comment 7 Matthew Stewart 2017-07-17 16:37:27 PDT
Created attachment 315726 [details]
Patch
Comment 8 dewei_zhu 2017-07-18 14:21:37 PDT
Comment on attachment 315726 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=315726&action=review

> Tools/Scripts/webkitpy/benchmark_runner/browser_driver/browser_driver.py:22
> +    def launch_driver(self, url, driver):
> +        pass

This function name is ambiguous with 'launch_driver(self, url, options, browser_build_path)'.

> Tools/Scripts/webkitpy/benchmark_runner/browser_driver/linux_minibrowsergtk_driver.py:43
> +        raise ValueError("Browser \"%s\" is not available with webdriver" % self.browser_name)

str.format is preferred.
Comment 9 Matthew Stewart 2017-07-19 13:56:29 PDT
Created attachment 315955 [details]
Patch
Comment 10 dewei_zhu 2017-07-19 17:26:37 PDT
Comment on attachment 315955 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=315955&action=review

> Tools/ChangeLog:5
> +

r=me
Comment 11 WebKit Commit Bot 2017-07-24 17:40:55 PDT
Comment on attachment 315955 [details]
Patch

Clearing flags on attachment: 315955

Committed r219850: <http://trac.webkit.org/changeset/219850>
Comment 12 WebKit Commit Bot 2017-07-24 17:40:57 PDT
All reviewed patches have been landed.  Closing bug.