Bug 232553 – Add a run-webkit-tests mode to A/B test a given feature

• Status: RESOLVED
• Resolution: FIXED
• Component: New Bugs

[Tim Horton]

Add a run-webkit-tests mode to A/B test a given feature

[Tim Horton]

Created attachment 442954 [details]
Patch

[Tim Horton]

I am super open to naming adjustments (I've solicited suggestions elsewhere, hopefully the patch helps people come up with something), I don't love the name as-is.

[Jonathan Bedard]

(In reply to Tim Horton from comment #2)
> I am super open to naming adjustments (I've solicited suggestions elsewhere,
> hopefully the patch helps people come up with something), I don't love the
> name as-is.

The name is the only thing I don't love....just some brainstormed options:

--compare-feature
--ab-test-feature
--feature-heade

I guess the problem I see is that the flag name is so long, maybe we keep the long name but also add a short one (maybe even just --ab or --feature) as an alternative

[Tim Horton]

I think the tricky part is you want the long name to cover both the fact that it is running the tests in a weird way AND explain what the value of the argument should be (our test header format), thus the length. I did originally have `--ab-header`, but I'm not sure `ab` very well conveys `A/B` :) Maybe it does!

[Tim Horton]

Created attachment 443000 [details]
Patch

[EWS]

Committed r285132 (243771@main): <https://commits.webkit.org/243771@main>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 443000 [details].

[Radar WebKit Bug Importer]

<rdar://problem/84899542>