Bug 263442 - [run-webkit-tests] Add --skip-flaky-tests
Summary: [run-webkit-tests] Add --skip-flaky-tests
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Sam Sneddon [:gsnedders]
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-10-20 06:58 PDT by Sam Sneddon [:gsnedders]
Modified: 2023-10-20 10:46 PDT (History)
1 user (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Sam Sneddon [:gsnedders] 2023-10-20 06:58:37 PDT 
When doing large rebaselines (e.g. for Bug 127676), we don't always want to rebaseline every test that's currently marked as flaky (as this can lead to constantly changing the expectations files, bloating the git repo for no gain).

Allow run-webkit-tests to skip flaky tests; this is similar to the existing --skip-failing-tests (which also skips flaky tests), but _does_ still run failing tests.
Comment 1 Radar WebKit Bug Importer 2023-10-20 06:58:50 PDT 
<rdar://problem/117260700>
Comment 2 Sam Sneddon [:gsnedders] 2023-10-20 07:09:17 PDT 
Pull request: https://github.com/WebKit/WebKit/pull/19340
Comment 3 EWS 2023-10-20 10:46:10 PDT 
Committed 269573@main (201382ace8db): <https://commits.webkit.org/269573@main>

Reviewed commits have been landed. Closing PR #19340 and removing active labels.