Bug 309696

Summary: [run-webkit-tests] Extend --test-list to support inline TestExpectations syntax
Product: WebKit Reporter: Basuke Suzuki <basuke>
Component: New BugsAssignee: Basuke Suzuki <basuke>
Status: RESOLVED FIXED    
Severity: Normal CC: webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Basuke Suzuki
Reported 2026-03-11 11:43:02 PDT
When investigating specific sets of tests (e.g., triaging failures, running a curated subset for a feature area), it is useful to annotate individual tests in the list file itself rather than editing the global TestExpectations files. This avoids polluting the shared expectations and allows ad-hoc, per-session control over test behavior. The `--test-list` option for `run-webkit-tests` accepts a text file listing test paths to run. Currently, the file format only supports plain test paths (one per line) with `//` comments. There is no way to annotate individual tests with expectations. This change extends the `--test-list` file format to support inline expectations using the standard TestExpectations bracket syntax: ``` # plain paths (existing behavior, unchanged) fast/dom/test1.html # with inline expectations (new) fast/dom/test2.html [ Skip ] fast/dom/test3.html [ Slow ] fast/dom/test4.html [ Pass Failure ] ```
Attachments
Basuke Suzuki
Comment 1 2026-03-11 11:44:18 PDT
Basuke Suzuki
Comment 2 2026-03-11 12:04:34 PDT
EWS
Comment 3 2026-03-11 13:54:17 PDT
Committed 309087@main (cb97940984ae): <https://commits.webkit.org/309087@main> Reviewed commits have been landed. Closing PR #60381 and removing active labels.
Note You need to log in before you can comment on or make changes to this bug.