Bug 214006 – W3C test importer should be able to update just the imported tests (without adding new directories for different test specs.)

• Component: Tools / Tests
• Status: RESOLVED FIXED

[Carlos Alberto Lopez Perez]

The process for updating all the WPT imported tests its the following (AFAIK):

1. Raise the WPT commit in LayoutTests/imported/w3c/resources/TestRepositories
2. Run the importer script: Tools/Scripts/import-w3c-tests


The problem is that when you try this, then you find that the importer script adds many new directories from test suites still not imported.
Basically is adding every directory from wpt that its not explicitly listed as skipped at LayoutTests/imported/w3c/resources/import-expectations.json


I think it would be useful to have a way of telling the tool to only update the tests already imported but without adding new folders for unrelated tests.

This is perhaps a happening since r206993 but not sure.

[Carlos Alberto Lopez Perez]

Created attachment 403627 [details]
Patch

[Carlos Alberto Lopez Perez]

Created attachment 403656 [details]
Patch

[Carlos Alberto Lopez Perez]

Note... this is supposed to be executed as:

1. Raise the WPT commit in LayoutTests/imported/w3c/resources/TestRepositories
2. Run the importer script (without passing any folder name, only the update-import switch): Tools/Scripts/import-w3c-tests --update-import -v

[Radar WebKit Bug Importer]

<rdar://problem/69332004>

[Sam Sneddon [:gsnedders]]

To make sure I understand what the goal here is:

Unlike passing a set of test paths on the command line, the aim is to simply update an existing partial import of WPT without importing test suites for new/other specifications?

If so, I think I'd rather than the current patch here:

 * Instead of using the presence of META.yml, just look at top-level directories of WPT and direct children of css/.
 * Add everything we're skipping to import-expectations.json (as "skip", to make it clear what we're not importing).

That said, could we not achieve the same goal by having the top-level marked as "skip" and then just allowlisting everything we want to import? Though that does have the one downside of making it easy to miss new directories we actually do want to import, versus explicitly adding everything new as "skip".

[Sam Sneddon [:gsnedders]]

Pull request: https://github.com/WebKit/WebKit/pull/19642

[EWS]

Committed 272109@main (e5fd5e058c53): <https://commits.webkit.org/272109@main>

Reviewed commits have been landed. Closing PR #19642 and removing active labels.