Bug 153832 - Re-sync W3C HTML web-platform-tests
Summary: Re-sync W3C HTML web-platform-tests
Alias: None
Product: WebKit
Classification: Unclassified
Component: DOM (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Chris Dumez
Depends on:
Blocks: 153677
  Show dependency treegraph
Reported: 2016-02-03 09:29 PST by Chris Dumez
Modified: 2016-02-06 09:57 PST (History)
5 users (show)

See Also:

Patch (141.75 KB, patch)
2016-02-03 13:47 PST, Chris Dumez
no flags Details | Formatted Diff | Diff
Archive of layout-test-results from ews103 for mac-yosemite (946.21 KB, application/zip)
2016-02-03 14:33 PST, Build Bot
no flags Details
Patch (138.06 KB, patch)
2016-02-03 14:42 PST, Chris Dumez
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Chris Dumez 2016-02-03 09:29:34 PST
Re-sync W3C HTML web-platform-tests
Comment 1 youenn fablet 2016-02-03 09:42:32 PST
Ideally, we would like to resync all wpt tests at once periodically.
That would mean:
- Update imported/w3c/resources/web-platform-tests-modules.json to the latest wpt revision
- Use w3c importer with the clean option (see https://bugs.webkit.org/show_bug.cgi?id=152685 patch that I did not yet committed) to remove all tests, but keeping -expected.txt files, then reimporting all tests.
- Reintegrate changes we made to specific tests (like previously the IDL test case so that it does not time out).
- Reintegrate all web-platform-tests/streams-api tests (need to be upstreamed to wpt) and web-platform-tests/fetch/api tests (resynchronization pull request on its way through github).
- Rerun all tests to generate expected.txt files

This process is a bit tedious and could probably be improved.
The test importer could delete only the tests that were removed between the revisions.
Maybe we should have a special process for tests we are modifying in WebKit before being modified in github WPT.
Comment 2 Chris Dumez 2016-02-03 13:47:02 PST
Created attachment 270599 [details]
Comment 3 Build Bot 2016-02-03 14:33:50 PST
Comment on attachment 270599 [details]

Attachment 270599 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.webkit.org/results/778660

New failing tests:
Comment 4 Build Bot 2016-02-03 14:33:54 PST
Created attachment 270600 [details]
Archive of layout-test-results from ews103 for mac-yosemite

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews103  Port: mac-yosemite  Platform: Mac OS X 10.10.5
Comment 5 Chris Dumez 2016-02-03 14:42:11 PST
Created attachment 270602 [details]
Comment 6 Chris Dumez 2016-02-03 16:04:37 PST
Comment on attachment 270602 [details]

Clearing flags on attachment: 270602

Committed r196091: <http://trac.webkit.org/changeset/196091>
Comment 7 Chris Dumez 2016-02-03 16:04:43 PST
All reviewed patches have been landed.  Closing bug.