Bug 151984 – Update web-platform-tests test suite

• Status: RESOLVED
• Resolution: FIXED
• Component: Tools / Tests

[youenn fablet]

Amongst changes added in the latest revision, some tests had same filenames but different extensions.
This caused conflicting test expectation files issues.

[youenn fablet]

Created attachment 266861 [details]
Patch

[Build Bot]

Comment on attachment 266861 [details]
Patch

Attachment 266861 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.webkit.org/results/532036

Number of test failures exceeded the failure limit.

[Build Bot]

Created attachment 266869 [details]
Archive of layout-test-results from ews101 for mac-yosemite

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews101  Port: mac-yosemite  Platform: Mac OS X 10.10.5

[Build Bot]

Comment on attachment 266861 [details]
Patch

Attachment 266861 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/532042

Number of test failures exceeded the failure limit.

[Build Bot]

Created attachment 266871 [details]
Archive of layout-test-results from ews107 for mac-yosemite-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews107  Port: mac-yosemite-wk2  Platform: Mac OS X 10.10.5

[Build Bot]

Comment on attachment 266861 [details]
Patch

Attachment 266861 [details] did not pass mac-debug-ews (mac):
Output: http://webkit-queues.webkit.org/results/532032

Number of test failures exceeded the failure limit.

[Build Bot]

Created attachment 266872 [details]
Archive of layout-test-results from ews114 for mac-yosemite

The attached test failures were seen while running run-webkit-tests on the mac-debug-ews.
Bot: ews114  Port: mac-yosemite  Platform: Mac OS X 10.10.5

[youenn fablet]

Created attachment 266877 [details]
Patch

[Build Bot]

Comment on attachment 266877 [details]
Patch

Attachment 266877 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/532596

Number of test failures exceeded the failure limit.

[Build Bot]

Created attachment 266879 [details]
Archive of layout-test-results from ews106 for mac-yosemite-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews106  Port: mac-yosemite-wk2  Platform: Mac OS X 10.10.5

[Build Bot]

Comment on attachment 266877 [details]
Patch

Attachment 266877 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.webkit.org/results/532610

New failing tests:
imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-dynamic-add-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-nextElementSibling-svg.svg
imported/w3c/web-platform-tests/XMLHttpRequest/send-entity-body-document.htm
imported/w3c/web-platform-tests/dom/nodes/Element-matches.html
imported/w3c/web-platform-tests/dom/nodes/MutationObserver-document.html
imported/w3c/web-platform-tests/XMLHttpRequest/send-content-type-charset.htm
imported/w3c/web-platform-tests/dom/nodes/Element-lastElementChild-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-firstElementChild-svg.svg
imported/w3c/web-platform-tests/dom/ranges/Range-surroundContents.html
imported/w3c/web-platform-tests/dom/nodes/Node-lookupNamespaceURI.html
imported/w3c/web-platform-tests/XMLHttpRequest/send-content-type-string.htm
imported/w3c/web-platform-tests/html/semantics/tabular-data/the-tr-element/deleteCell.html
imported/w3c/web-platform-tests/dom/nodes/Element-getElementsByTagName.html
imported/w3c/web-platform-tests/dom/nodes/ParentNode-querySelector-All.html
imported/w3c/web-platform-tests/dom/nodes/MutationObserver-childList.html
imported/w3c/web-platform-tests/dom/nodes/Element-childElement-null-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-nochild-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-siblingElement-null-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-children.html
imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-dynamic-remove-svg.svg
imported/w3c/web-platform-tests/XMLHttpRequest/XMLHttpRequest-withCredentials.html
imported/w3c/web-platform-tests/dom/nodes/Element-firstElementChild-namespace-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-previousElementSibling-svg.svg
imported/w3c/web-platform-tests/dom/nodes/attributes.html

[Build Bot]

Created attachment 266880 [details]
Archive of layout-test-results from ews103 for mac-yosemite

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews103  Port: mac-yosemite  Platform: Mac OS X 10.10.5

[Build Bot]

Comment on attachment 266877 [details]
Patch

Attachment 266877 [details] did not pass mac-debug-ews (mac):
Output: http://webkit-queues.webkit.org/results/532608

New failing tests:
imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-dynamic-add-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-nextElementSibling-svg.svg
imported/w3c/web-platform-tests/XMLHttpRequest/send-entity-body-document.htm
imported/w3c/web-platform-tests/dom/nodes/Element-matches.html
imported/w3c/web-platform-tests/dom/nodes/MutationObserver-document.html
imported/w3c/web-platform-tests/XMLHttpRequest/send-content-type-charset.htm
imported/w3c/web-platform-tests/dom/nodes/Element-lastElementChild-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-firstElementChild-svg.svg
imported/w3c/web-platform-tests/dom/ranges/Range-surroundContents.html
imported/w3c/web-platform-tests/dom/nodes/Node-lookupNamespaceURI.html
imported/w3c/web-platform-tests/XMLHttpRequest/send-content-type-string.htm
imported/w3c/web-platform-tests/html/semantics/tabular-data/the-tr-element/deleteCell.html
imported/w3c/web-platform-tests/dom/nodes/Element-getElementsByTagName.html
imported/w3c/web-platform-tests/dom/nodes/ParentNode-querySelector-All.html
imported/w3c/web-platform-tests/dom/nodes/MutationObserver-childList.html
imported/w3c/web-platform-tests/dom/nodes/Element-childElement-null-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-nochild-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-siblingElement-null-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-children.html
imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-dynamic-remove-svg.svg
imported/w3c/web-platform-tests/XMLHttpRequest/XMLHttpRequest-withCredentials.html
imported/w3c/web-platform-tests/dom/nodes/Element-firstElementChild-namespace-svg.svg
imported/w3c/web-platform-tests/dom/nodes/Element-previousElementSibling-svg.svg
imported/w3c/web-platform-tests/dom/nodes/attributes.html

[Build Bot]

Created attachment 266881 [details]
Archive of layout-test-results from ews114 for mac-yosemite

The attached test failures were seen while running run-webkit-tests on the mac-debug-ews.
Bot: ews114  Port: mac-yosemite  Platform: Mac OS X 10.10.5

[youenn fablet]

Created attachment 268183 [details]
Patch

[youenn fablet]

Created attachment 268186 [details]
Marking Document-createElement-namespace.html as flaky

[Build Bot]

Created attachment 268187 [details]
Archive of layout-test-results from ews100 for mac-yosemite

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews100  Port: mac-yosemite  Platform: Mac OS X 10.10.5

[Build Bot]

Created attachment 268188 [details]
Archive of layout-test-results from ews112 for mac-yosemite

The attached test failures were seen while running run-webkit-tests on the mac-debug-ews.
Bot: ews112  Port: mac-yosemite  Platform: Mac OS X 10.10.5

[Build Bot]

Created attachment 268189 [details]
Archive of layout-test-results from ews104 for mac-yosemite-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews104  Port: mac-yosemite-wk2  Platform: Mac OS X 10.10.5

[Daniel Bates]

Comment on attachment 268186 [details]
Marking Document-createElement-namespace.html as flaky

rs=me

For your consideration, I suggest mentioning in the ChangeLog entry(ies) that we are updating the tests downloaded from https://github.com/w3c/web-platform-tests.git at revision dd553279c3 to revision 5932fd48d519a83b4cca6ed69778547a4fdfc5ae. (It it OK that we do not mention the updated revisions of the dependent Python modules as these seem less important that the revision of the actual test files - though feel free to also mention these at your discretion). The benefit of mentioning the revision information of the update test files in the ChangeLog entry(ies) is that it makes it straightforward for a person to know what revision of the tests we are updating from and to by looking at the ChangeLog/commit message without having to look at some or all of the diff of this patch.

[youenn fablet]

Created attachment 268270 [details]
Patch for landing

[youenn fablet]

Created attachment 268271 [details]
Patch for landing

[youenn fablet]

Thanks for the review.

(In reply to comment #20)
> Comment on attachment 268186 [details]
> Marking Document-createElement-namespace.html as flaky
> 
> rs=me
> 
> For your consideration, I suggest mentioning in the ChangeLog entry(ies)
> that we are updating the tests downloaded from
> https://github.com/w3c/web-platform-tests.git at revision dd553279c3 to
> revision 5932fd48d519a83b4cca6ed69778547a4fdfc5ae. (It it OK that we do not
> mention the updated revisions of the dependent Python modules as these seem
> less important that the revision of the actual test files - though feel free
> to also mention these at your discretion). The benefit of mentioning the
> revision information of the update test files in the ChangeLog entry(ies) is
> that it makes it straightforward for a person to know what revision of the
> tests we are updating from and to by looking at the ChangeLog/commit message
> without having to look at some or all of the diff of this patch.

I updated the ChangeLog accordingly.

[WebKit Commit Bot]

Comment on attachment 268271 [details]
Patch for landing

Clearing flags on attachment: 268271

Committed r194580: <http://trac.webkit.org/changeset/194580>

[WebKit Commit Bot]

All reviewed patches have been landed.  Closing bug.