Bug 218985 - Automate WPT import and export
Summary: Automate WPT import and export
Status: ASSIGNED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Sam Sneddon [:gsnedders]
URL:
Keywords: InRadar
Depends on: 246221 246222
Blocks:
  Show dependency tree / graph
 
Reported: 2020-11-16 07:36 PST by Sam Sneddon [:gsnedders]
Modified: 2022-10-07 10:53 PDT (History)
2 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Sam Sneddon [:gsnedders] 2020-11-16 07:36:46 PST 
All the actual detail here is going to be in dependencies.
Comment 1 Radar WebKit Bug Importer 2020-11-16 07:36:56 PST 
<rdar://problem/71439680>
Comment 2 Sam Sneddon [:gsnedders] 2021-05-27 11:00:50 PDT 
Presently, we have four categories of tests listed in TestExpectations files:

1. Those which rely on subdomains (c.f. bug 127676), which we skip to avoid wasting time
2. Those which timeout, which we skip to avoid wasting time
3. Reftest failures, for which we store the expected failure status here
4. Flaky tests

A test import could cause one of the first two to change, which suggests when computing new expectations we need to run currently-skipped tests.