Bug 235125

Summary: Add post-commit build to run accessibility isolated tree mode layout tests
Product: WebKit Reporter: Tyler Wilcock <tyler_w>
Component: Tools / TestsAssignee: Tyler Wilcock <tyler_w>
Status: RESOLVED FIXED    
Severity: Normal CC: aakash_jain, aboxhall, andresg_22, apinheiro, ap, cfleizach, dmazzoni, ews-watchlist, jbedard, jcraig, jdiggs, ryanhaddad, samuel_white, tyler_w, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Patch
none
Patch
none
Patch
none
Patch
none
Patch
none
Patch
none
Patch
none
Patch none

Description Tyler Wilcock 2022-01-12 11:14:17 PST 
Add Big Sur post-commit build to run accessibility isolated tree mode layout tests.
Comment 1 Tyler Wilcock 2022-01-12 11:20:44 PST 
Created attachment 448973 [details]
Patch
Comment 2 Tyler Wilcock 2022-01-12 11:22:02 PST 
Comment on attachment 448973 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=448973&action=review

> Tools/CISupport/build-webkit-org/config.json:248
> +                      "additionalArguments": ["--no-retry-failures", "--accessibility-isolated-tree", "accessibility/"],

Is specifying "accessibility/" in additionalArguments a fine way to only run accessibility tests on this builder?

> Tools/CISupport/build-webkit-org/config.json:249
> +                      "workernames": ["bot302"]

What bot should I use for this new builder?
Comment 3 Tyler Wilcock 2022-01-13 19:42:43 PST 
Created attachment 449129 [details]
Patch
Comment 4 Radar WebKit Bug Importer 2022-01-19 11:20:33 PST 
<rdar://problem/87781868>
Comment 5 Aakash Jain 2022-01-19 17:47:45 PST 
Also need to change "platform" for bot179 in config.json to "mac-bigsur". That would also fix red services ews status-bubble.

Sample run: https://build.webkit-dev.org/#/builders/120/builds/2
Comment 6 Aakash Jain 2022-01-19 18:46:19 PST 
Comment on attachment 449129 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=449129&action=review

> Tools/CISupport/build-webkit-org/config.json:246
> +                    { "name": "Apple-BigSur-Release-WK2-Accessibility-Isolated-Tree-Tests", "factory": "TestAllButJSCFactory", "builddir": "bigsur-release-tests-wk2-accessibility-isolated-tree",

To run just the layout tests, you can replace TestAllButJSCFactory with TestLayoutFactory. Sample run: https://build.webkit-dev.org/#/builders/120/builds/4
Comment 7 Tyler Wilcock 2022-01-20 09:12:15 PST 
Created attachment 449588 [details]
Patch
Comment 8 Tyler Wilcock 2022-01-20 09:17:31 PST 
Created attachment 449589 [details]
Patch
Comment 9 Tyler Wilcock 2022-01-20 09:28:05 PST 
Created attachment 449591 [details]
Patch
Comment 10 Tyler Wilcock 2022-06-10 11:31:06 PDT 
Created attachment 460164 [details]
Patch
Comment 11 Tyler Wilcock 2022-06-10 11:45:23 PDT 
Created attachment 460165 [details]
Patch
Comment 12 Tyler Wilcock 2022-06-10 11:49:49 PDT 
Created attachment 460166 [details]
Patch
Comment 13 EWS 2022-06-10 14:22:24 PDT 
Committed r295462 (251468@main): <https://commits.webkit.org/251468@main>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 460166 [details].
Comment 14 Aakash Jain 2022-06-10 14:33:10 PDT 
Restarted build.webkit.org to pick up this change. The queue is live at https://build.webkit.org/#/builders/Apple-Monterey-Release-WK2-Accessibility-Isolated-Tree-Tests