Bug 151984

Summary:

Update web-platform-tests test suite

Product:

WebKit

Reporter:

youenn fablet <youennf>

Component:

Tools / Tests

Assignee:

youenn fablet <youennf>

Status:

RESOLVED FIXED

Severity:

Normal

CC:

buildbot, commit-queue, dbates, lforschler, rniwa

Priority:

Version:

WebKit Nightly Build

Hardware:

Unspecified

OS:

Unspecified

Attachments:

Description	Flags
Patch	none
Archive of layout-test-results from ews101 for mac-yosemite	none
Archive of layout-test-results from ews107 for mac-yosemite-wk2	none
Archive of layout-test-results from ews114 for mac-yosemite	none
Patch	none
Archive of layout-test-results from ews106 for mac-yosemite-wk2	none
Archive of layout-test-results from ews103 for mac-yosemite	none
Archive of layout-test-results from ews114 for mac-yosemite	none
Patch	none
Marking Document-createElement-namespace.html as flaky	dbates: review+
Archive of layout-test-results from ews100 for mac-yosemite	none
Archive of layout-test-results from ews112 for mac-yosemite	none
Archive of layout-test-results from ews104 for mac-yosemite-wk2	none
Patch for landing	none
Patch for landing	none

youenn fablet

Reported 2015-12-08 01:51:27 PST

Amongst changes added in the latest revision, some tests had same filenames but different extensions. This caused conflicting test expectation files issues.

Attachments
Patch (492.10 KB, patch) 2015-12-08 01:57 PST, youenn fablet	no flags	Details Formatted Diff Diff
Archive of layout-test-results from ews101 for mac-yosemite (988.12 KB, application/zip) 2015-12-08 02:35 PST, Build Bot	no flags	Details
Archive of layout-test-results from ews107 for mac-yosemite-wk2 (891.84 KB, application/zip) 2015-12-08 02:38 PST, Build Bot	no flags	Details
Archive of layout-test-results from ews114 for mac-yosemite (709.64 KB, application/zip) 2015-12-08 02:39 PST, Build Bot	no flags	Details
Patch (770.87 KB, patch) 2015-12-08 05:20 PST, youenn fablet	no flags	Details Formatted Diff Diff
Archive of layout-test-results from ews106 for mac-yosemite-wk2 (1.01 MB, application/zip) 2015-12-08 06:14 PST, Build Bot	no flags	Details
Archive of layout-test-results from ews103 for mac-yosemite (1.02 MB, application/zip) 2015-12-08 06:23 PST, Build Bot	no flags	Details
Archive of layout-test-results from ews114 for mac-yosemite (1.07 MB, application/zip) 2015-12-08 06:27 PST, Build Bot	no flags	Details
Patch (6.65 MB, patch) 2016-01-04 06:15 PST, youenn fablet	no flags	Details Formatted Diff Diff
Marking Document-createElement-namespace.html as flaky (6.65 MB, patch) 2016-01-04 07:13 PST, youenn fablet	dbates: review+	Details Formatted Diff Diff
Archive of layout-test-results from ews100 for mac-yosemite (695.75 KB, application/zip) 2016-01-04 07:14 PST, Build Bot	no flags	Details
Archive of layout-test-results from ews112 for mac-yosemite (743.35 KB, application/zip) 2016-01-04 07:15 PST, Build Bot	no flags	Details
Archive of layout-test-results from ews104 for mac-yosemite-wk2 (750.06 KB, application/zip) 2016-01-04 07:18 PST, Build Bot	no flags	Details
Patch for landing (6.64 MB, patch) 2016-01-05 00:21 PST, youenn fablet	no flags	Details Formatted Diff Diff
Patch for landing (6.64 MB, patch) 2016-01-05 00:24 PST, youenn fablet	no flags	Details Formatted Diff Diff
Show Obsolete (14) View All Add attachment proposed patch, testcase, etc.

youenn fablet

Comment 1 2015-12-08 01:57:31 PST

Created attachment 266861 [details] Patch

Build Bot

Comment 2 2015-12-08 02:35:21 PST

Comment on attachment 266861 [details] Patch Attachment 266861 [details] did not pass mac-ews (mac): Output: http://webkit-queues.webkit.org/results/532036 Number of test failures exceeded the failure limit.

Build Bot

Comment 3 2015-12-08 02:35:23 PST

Created attachment 266869 [details] Archive of layout-test-results from ews101 for mac-yosemite The attached test failures were seen while running run-webkit-tests on the mac-ews. Bot: ews101 Port: mac-yosemite Platform: Mac OS X 10.10.5

Build Bot

Comment 4 2015-12-08 02:38:46 PST

Comment on attachment 266861 [details] Patch Attachment 266861 [details] did not pass mac-wk2-ews (mac-wk2): Output: http://webkit-queues.webkit.org/results/532042 Number of test failures exceeded the failure limit.

Build Bot

Comment 5 2015-12-08 02:38:47 PST

Created attachment 266871 [details] Archive of layout-test-results from ews107 for mac-yosemite-wk2 The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews. Bot: ews107 Port: mac-yosemite-wk2 Platform: Mac OS X 10.10.5

Build Bot

Comment 6 2015-12-08 02:39:14 PST

Comment on attachment 266861 [details] Patch Attachment 266861 [details] did not pass mac-debug-ews (mac): Output: http://webkit-queues.webkit.org/results/532032 Number of test failures exceeded the failure limit.

Build Bot

Comment 7 2015-12-08 02:39:16 PST

Created attachment 266872 [details] Archive of layout-test-results from ews114 for mac-yosemite The attached test failures were seen while running run-webkit-tests on the mac-debug-ews. Bot: ews114 Port: mac-yosemite Platform: Mac OS X 10.10.5

youenn fablet

Comment 8 2015-12-08 05:20:49 PST

Created attachment 266877 [details] Patch

Build Bot

Comment 9 2015-12-08 06:14:08 PST

Comment on attachment 266877 [details] Patch Attachment 266877 [details] did not pass mac-wk2-ews (mac-wk2): Output: http://webkit-queues.webkit.org/results/532596 Number of test failures exceeded the failure limit.

Build Bot

Comment 10 2015-12-08 06:14:10 PST

Created attachment 266879 [details] Archive of layout-test-results from ews106 for mac-yosemite-wk2 The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews. Bot: ews106 Port: mac-yosemite-wk2 Platform: Mac OS X 10.10.5

Build Bot

Comment 11 2015-12-08 06:23:17 PST

Comment on attachment 266877 [details] Patch Attachment 266877 [details] did not pass mac-ews (mac): Output: http://webkit-queues.webkit.org/results/532610 New failing tests: imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-dynamic-add-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-nextElementSibling-svg.svg imported/w3c/web-platform-tests/XMLHttpRequest/send-entity-body-document.htm imported/w3c/web-platform-tests/dom/nodes/Element-matches.html imported/w3c/web-platform-tests/dom/nodes/MutationObserver-document.html imported/w3c/web-platform-tests/XMLHttpRequest/send-content-type-charset.htm imported/w3c/web-platform-tests/dom/nodes/Element-lastElementChild-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-firstElementChild-svg.svg imported/w3c/web-platform-tests/dom/ranges/Range-surroundContents.html imported/w3c/web-platform-tests/dom/nodes/Node-lookupNamespaceURI.html imported/w3c/web-platform-tests/XMLHttpRequest/send-content-type-string.htm imported/w3c/web-platform-tests/html/semantics/tabular-data/the-tr-element/deleteCell.html imported/w3c/web-platform-tests/dom/nodes/Element-getElementsByTagName.html imported/w3c/web-platform-tests/dom/nodes/ParentNode-querySelector-All.html imported/w3c/web-platform-tests/dom/nodes/MutationObserver-childList.html imported/w3c/web-platform-tests/dom/nodes/Element-childElement-null-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-nochild-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-siblingElement-null-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-children.html imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-dynamic-remove-svg.svg imported/w3c/web-platform-tests/XMLHttpRequest/XMLHttpRequest-withCredentials.html imported/w3c/web-platform-tests/dom/nodes/Element-firstElementChild-namespace-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-previousElementSibling-svg.svg imported/w3c/web-platform-tests/dom/nodes/attributes.html

Build Bot

Comment 12 2015-12-08 06:23:20 PST

Created attachment 266880 [details] Archive of layout-test-results from ews103 for mac-yosemite The attached test failures were seen while running run-webkit-tests on the mac-ews. Bot: ews103 Port: mac-yosemite Platform: Mac OS X 10.10.5

Build Bot

Comment 13 2015-12-08 06:27:33 PST

Comment on attachment 266877 [details] Patch Attachment 266877 [details] did not pass mac-debug-ews (mac): Output: http://webkit-queues.webkit.org/results/532608 New failing tests: imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-dynamic-add-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-nextElementSibling-svg.svg imported/w3c/web-platform-tests/XMLHttpRequest/send-entity-body-document.htm imported/w3c/web-platform-tests/dom/nodes/Element-matches.html imported/w3c/web-platform-tests/dom/nodes/MutationObserver-document.html imported/w3c/web-platform-tests/XMLHttpRequest/send-content-type-charset.htm imported/w3c/web-platform-tests/dom/nodes/Element-lastElementChild-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-firstElementChild-svg.svg imported/w3c/web-platform-tests/dom/ranges/Range-surroundContents.html imported/w3c/web-platform-tests/dom/nodes/Node-lookupNamespaceURI.html imported/w3c/web-platform-tests/XMLHttpRequest/send-content-type-string.htm imported/w3c/web-platform-tests/html/semantics/tabular-data/the-tr-element/deleteCell.html imported/w3c/web-platform-tests/dom/nodes/Element-getElementsByTagName.html imported/w3c/web-platform-tests/dom/nodes/ParentNode-querySelector-All.html imported/w3c/web-platform-tests/dom/nodes/MutationObserver-childList.html imported/w3c/web-platform-tests/dom/nodes/Element-childElement-null-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-nochild-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-siblingElement-null-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-children.html imported/w3c/web-platform-tests/dom/nodes/Element-childElementCount-dynamic-remove-svg.svg imported/w3c/web-platform-tests/XMLHttpRequest/XMLHttpRequest-withCredentials.html imported/w3c/web-platform-tests/dom/nodes/Element-firstElementChild-namespace-svg.svg imported/w3c/web-platform-tests/dom/nodes/Element-previousElementSibling-svg.svg imported/w3c/web-platform-tests/dom/nodes/attributes.html

Build Bot

Comment 14 2015-12-08 06:27:36 PST

Created attachment 266881 [details] Archive of layout-test-results from ews114 for mac-yosemite The attached test failures were seen while running run-webkit-tests on the mac-debug-ews. Bot: ews114 Port: mac-yosemite Platform: Mac OS X 10.10.5

youenn fablet

Comment 15 2016-01-04 06:15:44 PST

Created attachment 268183 [details] Patch

youenn fablet

Comment 16 2016-01-04 07:13:22 PST

Created attachment 268186 [details] Marking Document-createElement-namespace.html as flaky

Build Bot

Comment 17 2016-01-04 07:14:28 PST

Created attachment 268187 [details] Archive of layout-test-results from ews100 for mac-yosemite The attached test failures were seen while running run-webkit-tests on the mac-ews. Bot: ews100 Port: mac-yosemite Platform: Mac OS X 10.10.5

Build Bot

Comment 18 2016-01-04 07:15:41 PST

Created attachment 268188 [details] Archive of layout-test-results from ews112 for mac-yosemite The attached test failures were seen while running run-webkit-tests on the mac-debug-ews. Bot: ews112 Port: mac-yosemite Platform: Mac OS X 10.10.5

Build Bot

Comment 19 2016-01-04 07:18:53 PST

Created attachment 268189 [details] Archive of layout-test-results from ews104 for mac-yosemite-wk2 The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews. Bot: ews104 Port: mac-yosemite-wk2 Platform: Mac OS X 10.10.5

Daniel Bates

Comment 20 2016-01-04 09:18:31 PST

Comment on attachment 268186 [details] Marking Document-createElement-namespace.html as flaky rs=me For your consideration, I suggest mentioning in the ChangeLog entry(ies) that we are updating the tests downloaded from https://github.com/w3c/web-platform-tests.git at revision dd553279c3 to revision 5932fd48d519a83b4cca6ed69778547a4fdfc5ae. (It it OK that we do not mention the updated revisions of the dependent Python modules as these seem less important that the revision of the actual test files - though feel free to also mention these at your discretion). The benefit of mentioning the revision information of the update test files in the ChangeLog entry(ies) is that it makes it straightforward for a person to know what revision of the tests we are updating from and to by looking at the ChangeLog/commit message without having to look at some or all of the diff of this patch.

youenn fablet

Comment 21 2016-01-05 00:21:36 PST

Created attachment 268270 [details] Patch for landing

youenn fablet

Comment 22 2016-01-05 00:24:20 PST

Created attachment 268271 [details] Patch for landing

youenn fablet

Comment 23 2016-01-05 00:27:09 PST

Thanks for the review. (In reply to comment #20) > Comment on attachment 268186 [details] > Marking Document-createElement-namespace.html as flaky > > rs=me > > For your consideration, I suggest mentioning in the ChangeLog entry(ies) > that we are updating the tests downloaded from > https://github.com/w3c/web-platform-tests.git at revision dd553279c3 to > revision 5932fd48d519a83b4cca6ed69778547a4fdfc5ae. (It it OK that we do not > mention the updated revisions of the dependent Python modules as these seem > less important that the revision of the actual test files - though feel free > to also mention these at your discretion). The benefit of mentioning the > revision information of the update test files in the ChangeLog entry(ies) is > that it makes it straightforward for a person to know what revision of the > tests we are updating from and to by looking at the ChangeLog/commit message > without having to look at some or all of the diff of this patch. I updated the ChangeLog accordingly.

WebKit Commit Bot

Comment 24 2016-01-05 01:41:12 PST

Comment on attachment 268271 [details] Patch for landing Clearing flags on attachment: 268271 Committed r194580: <http://trac.webkit.org/changeset/194580>

WebKit Commit Bot

Comment 25 2016-01-05 01:41:17 PST

All reviewed patches have been landed. Closing bug.

Note You need to log in before you can comment on or make changes to this bug.