Bug 231925 - [EWS] Move EWS bots to iOS 15 / watchOS 8 / tvOS 15
Summary: [EWS] Move EWS bots to iOS 15 / watchOS 8 / tvOS 15
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: Other
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Ryan Haddad
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-10-18 17:16 PDT by Ryan Haddad
Modified: 2021-10-19 13:47 PDT (History)
7 users (show)

See Also:


Attachments
Patch (8.03 KB, patch)
2021-10-18 17:34 PDT, Ryan Haddad
no flags Details | Formatted Diff | Diff
Patch (10.53 KB, patch)
2021-10-19 09:45 PDT, Ryan Haddad
no flags Details | Formatted Diff | Diff
[fast-cq] Patch (10.56 KB, patch)
2021-10-19 13:44 PDT, Ryan Haddad
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2021-10-18 17:16:38 PDT
[EWS] Move EWS bots to iOS 15 / watchOS 8 / tvOS 15
Comment 1 Ryan Haddad 2021-10-18 17:34:13 PDT
Created attachment 441664 [details]
Patch
Comment 3 Aakash Jain 2021-10-19 06:04:56 PDT
Comment on attachment 441664 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=441664&action=review

> Tools/CISupport/ews-build/config.json:121
> +      "name": "iOS-15-Build-EWS", "shortname": "ios", "icon": "buildOnly",

I have wondered few times if it would be better to keep generic builder names like 'iOS-Build-EWS' instead of 'iOS-14-Build-EWS'. I don't have any major reasoning for deciding either way. Few points below.

Without the OS version in the name:
- We would have one less thing to update in our configuration.
- Buildbot wouldn't create new builder, maybe in very long term it might result in slightly better performance because of not having too many "old builders". 
- Switching to new queues will be smoother, since there wouldn't be any remaining pending builds on old queues after moving bots to new queues.
- 'Retry failed builds' button will still work for builds prior to moving the bots to newer OS (that's a very corner case in which 'Retry failed builds' button simply try to retry the failed build on old builder, but since there is no bot on old builder to process it, so it never gets retried).

One small reasoning for keeping the OS version in name can be that it makes it very obvious which OS we are running on each queue, both in buildbot and in status-bubbles. However, we display the OS and Xcode information through the PrintConfiguration step in every build in buildbot, and the same information is also displayed in status bubbles hover-over message.

Thoughts?
Comment 4 Ryan Haddad 2021-10-19 09:41:29 PDT
I think that removing the OS version from the name would be OK if we bubbled up the iOS/watchOS/tvOS version in the status bubbles and the printed configuration. I don't expect developers to be able to immediately correlate Xcode version with the particular simulator version being tested.
Comment 5 Aakash Jain 2021-10-19 09:44:42 PDT
(In reply to Ryan Haddad from comment #4)
> I think that removing the OS version from the name would be OK if we bubbled up the iOS/watchOS/tvOS version in the status bubbles and the printed configuration.
Yeah, we already do that. For example hover over any iOS/watchOS/tvOS status-bubble on the patch on this bug.
Comment 6 Ryan Haddad 2021-10-19 09:45:07 PDT
Created attachment 441743 [details]
Patch
Comment 7 Ryan Haddad 2021-10-19 09:46:19 PDT
(In reply to Aakash Jain from comment #5)
> (In reply to Ryan Haddad from comment #4)
> > I think that removing the OS version from the name would be OK if we bubbled up the iOS/watchOS/tvOS version in the status bubbles and the printed configuration.
> Yeah, we already do that. For example hover over any iOS/watchOS/tvOS
> status-bubble on the patch on this bug.
I only see the macOS version and the Xcode version.
Comment 8 Aakash Jain 2021-10-19 10:17:03 PDT
(In reply to Ryan Haddad from comment #7)
> I only see the macOS version and the Xcode version.
You are right, I misread your previous comment. 
That would be a larger effort to bubble up the iOS/watchOS/tvOS version, so let's leave that for now.
Comment 9 Ryan Haddad 2021-10-19 13:44:11 PDT
Created attachment 441785 [details]
[fast-cq] Patch
Comment 10 EWS 2021-10-19 13:46:40 PDT
Committed r284492 (243246@main): <https://commits.webkit.org/243246@main>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 441785 [details].
Comment 11 Radar WebKit Bug Importer 2021-10-19 13:47:24 PDT
<rdar://problem/84430972>