Bug 157170 – Sync web-platform-tests up to revision 4af8373

• Status: RESOLVED
• Resolution: FIXED
• Component: Tools / Tests

[youenn fablet]

Sync web-platform-tests up to revision 4af8373

[youenn fablet]

Created attachment 277693 [details]
Patch

[Build Bot]

Comment on attachment 277693 [details]
Patch

Attachment 277693 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.webkit.org/results/1239552

New failing tests:
imported/w3c/web-platform-tests/html/dom/reflection-original.html

[Build Bot]

Created attachment 277695 [details]
Archive of layout-test-results from ews101 for mac-yosemite

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews101  Port: mac-yosemite  Platform: Mac OS X 10.10.5

[Build Bot]

Comment on attachment 277693 [details]
Patch

Attachment 277693 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/1239546

New failing tests:
imported/w3c/web-platform-tests/html/dom/reflection-original.html

[Build Bot]

Created attachment 277696 [details]
Archive of layout-test-results from ews106 for mac-yosemite-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews106  Port: mac-yosemite-wk2  Platform: Mac OS X 10.10.5

[Build Bot]

Comment on attachment 277693 [details]
Patch

Attachment 277693 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/1239550

New failing tests:
imported/w3c/web-platform-tests/html/dom/reflection-original.html
imported/w3c/web-platform-tests/html/semantics/selectors/pseudo-classes/readwrite-readonly.html
imported/w3c/web-platform-tests/html/dom/interfaces.html
imported/w3c/web-platform-tests/dom/nodes/Document-createEvent.html
imported/w3c/web-platform-tests/html/semantics/forms/the-input-element/selection.html
imported/w3c/web-platform-tests/html/semantics/forms/constraints/form-validation-validity-badInput.html
imported/w3c/web-platform-tests/html/semantics/selectors/pseudo-classes/inrange-outofrange.html

[Build Bot]

Created attachment 277697 [details]
Archive of layout-test-results from ews125 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews125  Port: ios-simulator-wk2  Platform: Mac OS X 10.11.4

[youenn fablet]

Created attachment 277699 [details]
Patch

[youenn fablet]

(In reply to comment #8)
> Created attachment 277699 [details]
> Patch

Skipping import of reflection-original.html (not a WPT test file).
Marking ios-simulator tests as failing.

[Chris Dumez]

Comment on attachment 277699 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=277699&action=review

r=me

> LayoutTests/imported/w3c/resources/ImportExpectations:51
> +web-platform-tests/IndexedDB [ Skip ]

Why are see skipping these? I thought we had good IDB support now.

[youenn fablet]

Thanks for the review.

(In reply to comment #10)
> Comment on attachment 277699 [details]
> Patch
> 
> View in context:
> https://bugs.webkit.org/attachment.cgi?id=277699&action=review
> 
> r=me
> 
> > LayoutTests/imported/w3c/resources/ImportExpectations:51
> > +web-platform-tests/IndexedDB [ Skip ]
> 
> Why are see skipping these? I thought we had good IDB support now.

I initially moved these tests from LayoutTests/imported/w3c to  LayoutTests/imported/w3c/web-platform-tests.
But serving these tests through wptserve adds some overhead in terms of CPU and for debugging.
Since IDB tests are not requiring wptserver currently, they may be moved out of LayoutTests/imported/w3c/web-platform-tests.

See bug 155713 for more input.

[youenn fablet]

I'll land it over the week-end since this may create some flakiness.

[WebKit Commit Bot]

Comment on attachment 277699 [details]
Patch

Rejecting attachment 277699 [details] from commit-queue.

Failed to run "['/Volumes/Data/EWS/WebKit/Tools/Scripts/webkit-patch', '--status-host=webkit-queues.webkit.org', '--bot-id=webkit-cq-03', 'apply-attachment', '--no-update', '--non-interactive', 277699, '--port=mac']" exit_code: 2 cwd: /Volumes/Data/EWS/WebKit

Last 500 characters of output:
t-templates.js
patching file LayoutTests/platform/ios-simulator/TestExpectations
Hunk #1 FAILED at 3007.
1 out of 1 hunk FAILED -- saving rejects to file LayoutTests/platform/ios-simulator/TestExpectations.rej
patching file LayoutTests/platform/wk2/imported/w3c/web-platform-tests/html/semantics/document-metadata/styling/LinkStyle-expected.txt

Failed to run "[u'/Volumes/Data/EWS/WebKit/Tools/Scripts/svn-apply', '--force', '--reviewer', u'Chris Dumez']" exit_code: 1 cwd: /Volumes/Data/EWS/WebKit

Full output: http://webkit-queues.webkit.org/results/1244971

[youenn fablet]

Created attachment 277855 [details]
Patch for landing

[Build Bot]

Comment on attachment 277855 [details]
Patch for landing

Attachment 277855 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.webkit.org/results/1250329

New failing tests:
imported/w3c/web-platform-tests/dom/nodes/rootNode.html
imported/w3c/web-platform-tests/dom/interfaces.html

[Build Bot]

Created attachment 277856 [details]
Archive of layout-test-results from ews103 for mac-yosemite

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews103  Port: mac-yosemite  Platform: Mac OS X 10.10.5

[Build Bot]

Comment on attachment 277855 [details]
Patch for landing

Attachment 277855 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/1250326

New failing tests:
imported/w3c/web-platform-tests/dom/nodes/rootNode.html
imported/w3c/web-platform-tests/dom/interfaces.html

[Build Bot]

Created attachment 277857 [details]
Archive of layout-test-results from ews105 for mac-yosemite-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews105  Port: mac-yosemite-wk2  Platform: Mac OS X 10.10.5

[Build Bot]

Comment on attachment 277855 [details]
Patch for landing

Attachment 277855 [details] did not pass ios-sim-ews (ios-simulator-wk2):
Output: http://webkit-queues.webkit.org/results/1250331

New failing tests:
imported/w3c/web-platform-tests/dom/nodes/rootNode.html
imported/w3c/web-platform-tests/dom/interfaces.html

[Build Bot]

Created attachment 277858 [details]
Archive of layout-test-results from ews121 for ios-simulator-wk2

The attached test failures were seen while running run-webkit-tests on the ios-sim-ews.
Bot: ews121  Port: ios-simulator-wk2  Platform: Mac OS X 10.11.4

[Build Bot]

Comment on attachment 277855 [details]
Patch for landing

Attachment 277855 [details] did not pass mac-debug-ews (mac):
Output: http://webkit-queues.webkit.org/results/1250332

New failing tests:
imported/w3c/web-platform-tests/dom/nodes/rootNode.html

[Build Bot]

Created attachment 277859 [details]
Archive of layout-test-results from ews114 for mac-yosemite

The attached test failures were seen while running run-webkit-tests on the mac-debug-ews.
Bot: ews114  Port: mac-yosemite  Platform: Mac OS X 10.10.5

[youenn fablet]

Created attachment 277860 [details]
Rebasing failing tests

[WebKit Commit Bot]

Comment on attachment 277860 [details]
Rebasing failing tests

Rejecting attachment 277860 [details] from commit-queue.

Failed to run "['/Volumes/Data/EWS/WebKit/Tools/Scripts/webkit-patch', '--status-host=webkit-queues.webkit.org', '--bot-id=webkit-cq-01', 'land-attachment', '--force-clean', '--non-interactive', '--parent-command=commit-queue', 277860, '--port=mac']" exit_code: 2 cwd: /Volumes/Data/EWS/WebKit

Last 500 characters of output:
..4ca32e4  master     -> origin/master
Partial-rebuilding .git/svn/refs/remotes/origin/master/.rev_map.268f45cc-cd09-0410-ab3c-d52691b4dbfc ...
Currently at 200302 = 3065521ff6a0ae796b6c411f754481f29c7f27db
r200303 = 4ca32e45ca8829f20fb7f770648a9b54f7a00b33
Done rebuilding .git/svn/refs/remotes/origin/master/.rev_map.268f45cc-cd09-0410-ab3c-d52691b4dbfc
First, rewinding head to replay your work on top of it...
Fast-forwarded master to refs/remotes/origin/master.
Total errors found: 0 in 1 files

Full output: http://webkit-queues.webkit.org/results/1250677

[Ryan Haddad]

imported/w3c/web-platform-tests/html/dom/interfaces.html is timing out on iOS simulator after <http://trac.webkit.org/changeset/200309> was landed.

http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fdom%2Finterfaces.html

[Chris Dumez]

Comment on attachment 277860 [details]
Rebasing failing tests

View in context: https://bugs.webkit.org/attachment.cgi?id=277860&action=review

> LayoutTests/imported/w3c/web-platform-tests/dom/nodes/Element-insertAdjacentElement-expected.txt:3
> +

This fully empty expected result does not seem right.

> LayoutTests/imported/w3c/web-platform-tests/dom/nodes/Element-insertAdjacentText-expected.txt:2
> +

This fully empty expected result does not seem right.

> LayoutTests/imported/w3c/web-platform-tests/dom/nodes/Node-contains-xml-expected.txt:2
> +

This mostly empty result does not seem right.

[Chris Dumez]

(In reply to comment #26)
> Comment on attachment 277860 [details]
> Rebasing failing tests
> 
> View in context:
> https://bugs.webkit.org/attachment.cgi?id=277860&action=review
> 
> > LayoutTests/imported/w3c/web-platform-tests/dom/nodes/Element-insertAdjacentElement-expected.txt:3
> > +
> 
> This fully empty expected result does not seem right.
> 
> > LayoutTests/imported/w3c/web-platform-tests/dom/nodes/Element-insertAdjacentText-expected.txt:2
> > +
> 
> This fully empty expected result does not seem right.
> 
> > LayoutTests/imported/w3c/web-platform-tests/dom/nodes/Node-contains-xml-expected.txt:2
> > +
> 
> This mostly empty result does not seem right.

I know the problem for the 2 first ones at least, I'll fix shortly.