Bug 159712

Summary: Refresh WPT tests up to c875b42
Product: WebKit Reporter: youenn fablet <youennf>
Component: TextAssignee: youenn fablet <youennf>
Status: RESOLVED FIXED    
Severity: Normal CC: achristensen, buildbot, cdumez, commit-queue, mcatanzaro, mmaxfield, rniwa
Priority: P2    
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Patch
none
Archive of layout-test-results from ews102 for mac-yosemite
none
Archive of layout-test-results from ews114 for mac-yosemite
none
Archive of layout-test-results from ews104 for mac-yosemite-wk2
none
Archive of layout-test-results from ews122 for ios-simulator-wk2
none
Rebasing failing tests
none
Patch none

youenn fablet
Reported 2016-07-13 04:05:30 PDT
Refresh WPT tests up to c875b42
Attachments
Patch (266.45 KB, patch)
2016-07-13 04:08 PDT, youenn fablet
no flags
Archive of layout-test-results from ews102 for mac-yosemite (1.19 MB, application/zip)
2016-07-13 04:46 PDT, Build Bot
no flags
Archive of layout-test-results from ews114 for mac-yosemite (1.35 MB, application/zip)
2016-07-13 04:52 PDT, Build Bot
no flags
Archive of layout-test-results from ews104 for mac-yosemite-wk2 (1.03 MB, application/zip)
2016-07-13 05:00 PDT, Build Bot
no flags
Archive of layout-test-results from ews122 for ios-simulator-wk2 (533.12 KB, application/zip)
2016-07-13 05:19 PDT, Build Bot
no flags
Rebasing failing tests (290.46 KB, patch)
2016-07-13 05:26 PDT, youenn fablet
no flags
Patch (1.86 KB, patch)
2016-10-06 02:07 PDT, youenn fablet
no flags
youenn fablet
Comment 1 2016-07-13 04:08:52 PDT
Build Bot
Comment 2 2016-07-13 04:46:26 PDT
Comment on attachment 283511 [details] Patch Attachment 283511 [details] did not pass mac-ews (mac): Output: http://webkit-queues.webkit.org/results/1673762 New failing tests: imported/w3c/web-platform-tests/html/dom/interfaces.html imported/w3c/web-platform-tests/XMLHttpRequest/response-method.htm
Build Bot
Comment 3 2016-07-13 04:46:29 PDT
Created attachment 283512 [details] Archive of layout-test-results from ews102 for mac-yosemite The attached test failures were seen while running run-webkit-tests on the mac-ews. Bot: ews102 Port: mac-yosemite Platform: Mac OS X 10.10.5
Build Bot
Comment 4 2016-07-13 04:52:35 PDT
Comment on attachment 283511 [details] Patch Attachment 283511 [details] did not pass mac-debug-ews (mac): Output: http://webkit-queues.webkit.org/results/1673760 New failing tests: imported/w3c/web-platform-tests/XMLHttpRequest/response-method.htm
Build Bot
Comment 5 2016-07-13 04:52:37 PDT
Created attachment 283513 [details] Archive of layout-test-results from ews114 for mac-yosemite The attached test failures were seen while running run-webkit-tests on the mac-debug-ews. Bot: ews114 Port: mac-yosemite Platform: Mac OS X 10.10.5
Build Bot
Comment 6 2016-07-13 05:00:05 PDT
Comment on attachment 283511 [details] Patch Attachment 283511 [details] did not pass mac-wk2-ews (mac-wk2): Output: http://webkit-queues.webkit.org/results/1673808 New failing tests: imported/w3c/web-platform-tests/html/dom/interfaces.html imported/w3c/web-platform-tests/XMLHttpRequest/response-method.htm
Build Bot
Comment 7 2016-07-13 05:00:08 PDT
Created attachment 283515 [details] Archive of layout-test-results from ews104 for mac-yosemite-wk2 The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews. Bot: ews104 Port: mac-yosemite-wk2 Platform: Mac OS X 10.10.5
Build Bot
Comment 8 2016-07-13 05:19:46 PDT
Comment on attachment 283511 [details] Patch Attachment 283511 [details] did not pass ios-sim-ews (ios-simulator-wk2): Output: http://webkit-queues.webkit.org/results/1673827 New failing tests: imported/w3c/web-platform-tests/XMLHttpRequest/response-method.htm
Build Bot
Comment 9 2016-07-13 05:19:49 PDT
Created attachment 283519 [details] Archive of layout-test-results from ews122 for ios-simulator-wk2 The attached test failures were seen while running run-webkit-tests on the ios-sim-ews. Bot: ews122 Port: ios-simulator-wk2 Platform: Mac OS X 10.11.5
youenn fablet
Comment 10 2016-07-13 05:26:39 PDT
Created attachment 283520 [details] Rebasing failing tests
Chris Dumez
Comment 11 2016-07-13 09:07:36 PDT
Comment on attachment 283520 [details] Rebasing failing tests View in context: https://bugs.webkit.org/attachment.cgi?id=283520&action=review r=me > LayoutTests/imported/w3c/web-platform-tests/dom/events/EventListener-incumbent-global-1.sub-expected.txt:6 > +TIMEOUT Check the incumbent global EventListeners are called with Test timed out Isn't this a sub resource (given the .sub in the name)? Should it be skipped instead of having an -expected.txt? > LayoutTests/imported/w3c/web-platform-tests/dom/events/EventListener-incumbent-global-2.sub-expected.txt:4 > +Harness Error (TIMEOUT), message = null Isn't this a sub resource (given the .sub in the name)? Should it be skipped instead of having an -expected.txt?
Chris Dumez
Comment 12 2016-07-13 09:08:12 PDT
Comment on attachment 283520 [details] Rebasing failing tests Temporarily clearing the cq until you answer my question. cq+ again if my comment is wrong.
youenn fablet
Comment 13 2016-07-13 09:16:38 PDT
(In reply to comment #11) > Comment on attachment 283520 [details] > Rebasing failing tests > > View in context: > https://bugs.webkit.org/attachment.cgi?id=283520&action=review > > r=me > > > LayoutTests/imported/w3c/web-platform-tests/dom/events/EventListener-incumbent-global-1.sub-expected.txt:6 > > +TIMEOUT Check the incumbent global EventListeners are called with Test timed out > > Isn't this a sub resource (given the .sub in the name)? Should it be skipped > instead of having an -expected.txt? > > > LayoutTests/imported/w3c/web-platform-tests/dom/events/EventListener-incumbent-global-2.sub-expected.txt:4 > > +Harness Error (TIMEOUT), message = null > > Isn't this a sub resource (given the .sub in the name)? Should it be skipped > instead of having an -expected.txt? WPT has some processing rules based on filenames. Files like xx.sub.html will be preprocessed within wpt server to replace some macros, typically hostname and ports related macros. Files like yy.https.html will be executed after being loaded through https. Currently, the test importer is trying to detect whether files are resources or tests by looking at testharness.js/testharnessreport.js links. Ideally, we should use the scripts in wpt to generate that list but so far, this heuristic is kind of working. (In reply to comment #12) > Comment on attachment 283520 [details] > Rebasing failing tests > > Temporarily clearing the cq until you answer my question. cq+ again if my > comment is wrong. np
youenn fablet
Comment 14 2016-07-13 09:18:03 PDT
> > Isn't this a sub resource (given the .sub in the name)? Should it be skipped > > instead of having an -expected.txt? > > WPT has some processing rules based on filenames. > Files like xx.sub.html will be preprocessed within wpt server to replace > some macros, typically hostname and ports related macros. > Files like yy.https.html will be executed after being loaded through https. For js files, you may find some links like src="test.js?pipe=sub" This is the same kind of processing.
WebKit Commit Bot
Comment 15 2016-07-13 09:31:27 PDT
Comment on attachment 283520 [details] Rebasing failing tests Clearing flags on attachment: 283520 Committed r203164: <http://trac.webkit.org/changeset/203164>
WebKit Commit Bot
Comment 16 2016-07-13 09:31:32 PDT
All reviewed patches have been landed. Closing bug.
Michael Catanzaro
Comment 17 2016-07-23 15:08:43 PDT
Reopening because several failing tests are marked against this bug: webkit.org/b/159712 imported/w3c/web-platform-tests/html/semantics/document-metadata/the-link-element/document-without-browsing-context.html [ Timeout ] webkit.org/b/159712 imported/w3c/web-platform-tests/html/semantics/embedded-content/the-iframe-element/iframe_sandbox_popups_escaping.html [ Failure Pass ] webkit.org/b/159712 imported/w3c/web-platform-tests/html/semantics/embedded-content/the-iframe-element/iframe_sandbox_popups_nonescaping.html [ Failure Pass ] webkit.org/b/159712 imported/w3c/web-platform-tests/XMLHttpRequest/open-url-multi-window-6.htm [ Pass Timeout ] You can mark them against a new bug if you want to close this one! I'm also updating the expectations for imported/w3c/web-platform-tests/html/semantics/document-metadata/the-link-element/document-without-browsing-context.html to reflect that it's no longer timing out, but now flakily passing/failing, since r203637-r203638 on the GTK port.
youenn fablet
Comment 18 2016-10-06 02:07:50 PDT
WebKit Commit Bot
Comment 19 2016-10-06 03:40:43 PDT
Comment on attachment 290797 [details] Patch Clearing flags on attachment: 290797 Committed r206860: <http://trac.webkit.org/changeset/206860>
WebKit Commit Bot
Comment 20 2016-10-06 03:40:50 PDT
All reviewed patches have been landed. Closing bug.
Note You need to log in before you can comment on or make changes to this bug.