Bug 148726 - Web Inspector: combine Test.html resources to make tests run faster
Summary: Web Inspector: combine Test.html resources to make tests run faster
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Web Inspector (show other bugs)
Version: WebKit Nightly Build
Hardware: All All
: P2 Normal
Assignee: BJ Burg
URL:
Keywords: InRadar
Depends on: 148728
Blocks: InspectorTest
  Show dependency treegraph
 
Reported: 2015-09-02 15:14 PDT by BJ Burg
Modified: 2015-09-04 22:30 PDT (History)
11 users (show)

See Also:


Attachments
Proposed Fix (17.74 KB, patch)
2015-09-02 17:59 PDT, BJ Burg
no flags Details | Formatted Diff | Diff
Archive of layout-test-results from ews101 for mac-mavericks (715.54 KB, application/zip)
2015-09-02 18:20 PDT, Build Bot
no flags Details
Archive of layout-test-results from ews106 for mac-mavericks-wk2 (782.11 KB, application/zip)
2015-09-02 18:25 PDT, Build Bot
no flags Details
Proposed fix, no minifying (17.52 KB, patch)
2015-09-04 17:23 PDT, BJ Burg
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description BJ Burg 2015-09-02 15:14:15 PDT
Today's hypothesis is that inspector tests may be slow on low-spec bots because they have to synchronously load all of Test.html's resources individually from slow spinning hard drives. Let's try concatenating them (not minifying) to see if there's any significant difference.
Comment 1 Radar WebKit Bug Importer 2015-09-02 16:18:11 PDT
<rdar://problem/22548705>
Comment 2 BJ Burg 2015-09-02 17:59:27 PDT
Created attachment 260463 [details]
Proposed Fix

Does not apply, depends on jsmin update and bugfix.
Comment 3 Build Bot 2015-09-02 18:20:31 PDT
Comment on attachment 260463 [details]
Proposed Fix

Attachment 260463 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.webkit.org/results/134765

New failing tests:
inspector/dom/pseudo-element-dynamic.html
inspector/css/stylesheet-events-inspector-stylesheet.html
inspector/dom/setOuterHTML.html
inspector/model/remote-object-fake-object.html
inspector/dom/template-content.html
inspector/css/stylesheet-events-basic.html
inspector/dom/getOuterHTML.html
inspector/css/stylesheet-events-imports.html
inspector/protocol/inspector-backend-invocation-return-value.html
inspector/console/command-line-api.html
http/tests/inspector/dom/disconnect-dom-tree-after-main-frame-navigation.html
inspector/dom/pseudo-element-static.html
inspector/css/stylesheet-events-multiple-documents.html
Comment 4 Build Bot 2015-09-02 18:20:35 PDT
Created attachment 260468 [details]
Archive of layout-test-results from ews101 for mac-mavericks

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews101  Port: mac-mavericks  Platform: Mac OS X 10.9.5
Comment 5 Build Bot 2015-09-02 18:24:59 PDT
Comment on attachment 260463 [details]
Proposed Fix

Attachment 260463 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/134777

New failing tests:
inspector/dom/pseudo-element-dynamic.html
inspector/dom/template-content.html
inspector/model/remote-object-fake-object.html
inspector/indexeddb/requestDatabaseNames.html
inspector/dom/setOuterHTML.html
inspector/css/stylesheet-events-basic.html
inspector/dom/getOuterHTML.html
inspector/css/stylesheet-events-imports.html
inspector/css/stylesheet-events-inspector-stylesheet.html
inspector/protocol/inspector-backend-invocation-return-value.html
inspector/console/command-line-api.html
http/tests/inspector/dom/disconnect-dom-tree-after-main-frame-navigation.html
inspector/dom/pseudo-element-static.html
inspector/css/stylesheet-events-multiple-documents.html
Comment 6 Build Bot 2015-09-02 18:25:04 PDT
Created attachment 260469 [details]
Archive of layout-test-results from ews106 for mac-mavericks-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews106  Port: mac-mavericks-wk2  Platform: Mac OS X 10.9.5
Comment 7 Timothy Hatcher 2015-09-03 14:49:58 PDT
Comment on attachment 260463 [details]
Proposed Fix

Why the Mac failures?
Comment 8 BJ Burg 2015-09-04 09:57:35 PDT
(In reply to comment #7)
> Comment on attachment 260463 [details]
> Proposed Fix
> 
> Why the Mac failures?

There are diffs caused by template strings getting minified wrong. Should not be a problem when dependencies land.
Comment 9 BJ Burg 2015-09-04 17:23:44 PDT
Created attachment 260657 [details]
Proposed fix, no minifying

This patch version just concats all test files together. Speed improvement was negligible (1-3s faster) on a newish imac, but might make a bigger difference on older hardware. Will test out on my fossilized macbook pro before landing.
Comment 10 BJ Burg 2015-09-04 21:46:03 PDT
On my old machine (2009 laptop with core 2 duo and 4GB RAM, but still faster than our build bots by a lot), this reduced inspector testing time from 1m50s to 1m30s (cold start) and from 1m15s to 1m on a warmed up file cache. Let's see what happens and roll out if it makes things worse.
Comment 11 Timothy Hatcher 2015-09-04 22:24:30 PDT
SSD or hard drive?
Comment 12 WebKit Commit Bot 2015-09-04 22:29:57 PDT
Comment on attachment 260657 [details]
Proposed fix, no minifying

Clearing flags on attachment: 260657

Committed r189420: <http://trac.webkit.org/changeset/189420>
Comment 13 WebKit Commit Bot 2015-09-04 22:30:04 PDT
All reviewed patches have been landed.  Closing bug.