Bug 153832

Summary: Re-sync W3C HTML web-platform-tests
Product: WebKit Reporter: Chris Dumez <cdumez>
Component: DOMAssignee: Chris Dumez <cdumez>
Status: RESOLVED FIXED    
Severity: Normal CC: buildbot, commit-queue, darin, rniwa, youennf
Priority: P2    
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=153948
Bug Depends on:    
Bug Blocks: 153677    
Attachments:
Description Flags
Patch
none
Archive of layout-test-results from ews103 for mac-yosemite
none
Patch none

Description Chris Dumez 2016-02-03 09:29:34 PST
Re-sync W3C HTML web-platform-tests
Comment 1 youenn fablet 2016-02-03 09:42:32 PST
Ideally, we would like to resync all wpt tests at once periodically.
That would mean:
- Update imported/w3c/resources/web-platform-tests-modules.json to the latest wpt revision
- Use w3c importer with the clean option (see https://bugs.webkit.org/show_bug.cgi?id=152685 patch that I did not yet committed) to remove all tests, but keeping -expected.txt files, then reimporting all tests.
- Reintegrate changes we made to specific tests (like previously the IDL test case so that it does not time out).
- Reintegrate all web-platform-tests/streams-api tests (need to be upstreamed to wpt) and web-platform-tests/fetch/api tests (resynchronization pull request on its way through github).
- Rerun all tests to generate expected.txt files

This process is a bit tedious and could probably be improved.
The test importer could delete only the tests that were removed between the revisions.
Maybe we should have a special process for tests we are modifying in WebKit before being modified in github WPT.
Comment 2 Chris Dumez 2016-02-03 13:47:02 PST
Created attachment 270599 [details]
Patch
Comment 3 Build Bot 2016-02-03 14:33:50 PST
Comment on attachment 270599 [details]
Patch

Attachment 270599 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.webkit.org/results/778660

New failing tests:
imported/w3c/web-platform-tests/html/semantics/embedded-content/the-area-element/area-coords.html
imported/w3c/web-platform-tests/html/semantics/forms/the-button-element/button-activate-frame.html
imported/w3c/web-platform-tests/html/semantics/document-metadata/styling/LinkStyle.html
Comment 4 Build Bot 2016-02-03 14:33:54 PST
Created attachment 270600 [details]
Archive of layout-test-results from ews103 for mac-yosemite

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews103  Port: mac-yosemite  Platform: Mac OS X 10.10.5
Comment 5 Chris Dumez 2016-02-03 14:42:11 PST
Created attachment 270602 [details]
Patch
Comment 6 Chris Dumez 2016-02-03 16:04:37 PST
Comment on attachment 270602 [details]
Patch

Clearing flags on attachment: 270602

Committed r196091: <http://trac.webkit.org/changeset/196091>
Comment 7 Chris Dumez 2016-02-03 16:04:43 PST
All reviewed patches have been landed.  Closing bug.