Bug 221263 - [build.webkit.org] unzip layout-test-results in background
Summary: [build.webkit.org] unzip layout-test-results in background
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: Other
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Aakash Jain
URL:
Keywords: InRadar
Depends on:
Blocks: 175056
  Show dependency treegraph
 
Reported: 2021-02-02 08:58 PST by Aakash Jain
Modified: 2021-02-12 10:10 PST (History)
5 users (show)

See Also:


Attachments
Patch (1.48 KB, patch)
2021-02-02 09:01 PST, Aakash Jain
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Aakash Jain 2021-02-02 08:58:56 PST
Unzipping layout-test-results might take a long time (few minutes), especially with a S3 mount for results. e.g.: 8 minutes in https://build.webkit-dev.org/#/builders/28/builds/5

However, while unzipping is done on server, we don't really need to block the build during that time, we can move the unzip operation to background so that the bot can process the next build.
Comment 1 Aakash Jain 2021-02-02 09:01:54 PST
Created attachment 419006 [details]
Patch
Comment 2 Aakash Jain 2021-02-02 09:04:15 PST
Ling configured AWS lambda to automatically unzip the zip files created on results volume.

Sample run: https://build.webkit-dev.org/#/builders/32/builds/20
Comment 3 EWS 2021-02-02 10:23:45 PST
Committed r272220: <https://trac.webkit.org/changeset/272220>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 419006 [details].
Comment 4 Radar WebKit Bug Importer 2021-02-02 10:24:57 PST
<rdar://problem/73886325>
Comment 5 Aakash Jain 2021-02-08 07:35:03 PST
Temporarily reverted this on the server (on 2021-02-06) since the lambda was timing out.