Bug 256283 - [WPE] Add new post-commit bots for performance tests with RPis
Summary: [WPE] Add new post-commit bots for performance tests with RPis
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Carlos Alberto Lopez Perez
URL:
Keywords: InRadar
Depends on: 255861
Blocks: 249031
  Show dependency treegraph
 
Reported: 2023-05-03 16:46 PDT by Carlos Alberto Lopez Perez
Modified: 2023-08-15 15:02 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Carlos Alberto Lopez Perez 2023-05-03 16:46:00 PDT Comment hidden (obsolete)
Comment 1 Carlos Alberto Lopez Perez 2023-05-03 16:49:51 PDT
Now that the tooling for cross-building WebKit for a target device and running tests with it has landed (see bug 249031) it is time to add the bots

The main idea for the bots is the following

1) Build-only bot
- A bot (x86_64) will cross-build WPE for a specific target board like any of this: rpi3-32bits-mesa-vc4, rpi3-32bits-userland, rpi4-32bits-mesa-vc4, rpi3-64bits-mesa-vc4, rpi4-64bits-mesa-vc4
- The bot will also generate the image (OS) that will run on the board. This image will contain everything needed except WPE itself

2) Test-only bots
- This will be a set of RPis boards, each one will boot the image that was generated from the build-only boot (via NFS/tftp)
- The RPi will download the built-product from the build-only bot (point 1 above) and run the performance tests
- For running the performance tests it will use the script browserperfdash-benchmark which is a wrapper around the script run-benchmark
- The results of the benchmarks will be uploaded to https://browserperfdash.igalia.com/


The proposed initial config contain this:

1) Two build-only bots for two build configurations:

 - WPE-Linux-RPi4-32bits-Mesa-Release-Perf-Build (builds with --cross-target=rpi4-32bits-mesa)
 - WPE-Linux-RPi4-64bits-Mesa-Release-Perf-Build (builds with --cross-target=rpi4-64bits-mesa)


2) 16 RPi4 testers for that configurations:

  - 8 RPi4 for the 32 bits config
  - 8 Rpi4 for the 64 bits config
Comment 2 Carlos Alberto Lopez Perez 2023-05-03 18:41:08 PDT
Pull request: https://github.com/WebKit/WebKit/pull/13430
Comment 3 EWS 2023-06-01 10:01:48 PDT
Committed 264798@main (e7e596ed660c): <https://commits.webkit.org/264798@main>

Reviewed commits have been landed. Closing PR #13430 and removing active labels.
Comment 4 Radar WebKit Bug Importer 2023-06-01 10:02:18 PDT
<rdar://problem/110120132>
Comment 5 Aakash Jain 2023-06-13 11:51:55 PDT
Restarted build.webkit.org to pick up this change this morning.