Bug 201753 - Re-sync HTML web-platform-tests from upstream
Summary: Re-sync HTML web-platform-tests from upstream
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Text (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Chris Dumez
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2019-09-12 21:10 PDT by Chris Dumez
Modified: 2019-09-16 09:13 PDT (History)
8 users (show)

See Also:


Attachments
Patch (5.67 MB, patch)
2019-09-12 21:19 PDT, Chris Dumez
no flags Details | Formatted Diff | Diff
Patch (5.62 MB, patch)
2019-09-12 21:23 PDT, Chris Dumez
no flags Details | Formatted Diff | Diff
Patch (5.62 MB, patch)
2019-09-12 21:24 PDT, Chris Dumez
no flags Details | Formatted Diff | Diff
Patch (6.98 MB, patch)
2019-09-13 09:03 PDT, Chris Dumez
no flags Details | Formatted Diff | Diff
Patch (8.00 MB, patch)
2019-09-13 12:24 PDT, Chris Dumez
no flags Details | Formatted Diff | Diff
Patch (7.89 MB, patch)
2019-09-15 09:43 PDT, Chris Dumez
no flags Details | Formatted Diff | Diff
Patch (7.89 MB, patch)
2019-09-15 11:54 PDT, Chris Dumez
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Chris Dumez 2019-09-12 21:10:56 PDT
Re-sync HTML web-platform-tests from upstream.
Comment 1 Chris Dumez 2019-09-12 21:19:39 PDT
Created attachment 378709 [details]
Patch
Comment 2 Chris Dumez 2019-09-12 21:23:32 PDT
Created attachment 378711 [details]
Patch
Comment 3 Chris Dumez 2019-09-12 21:24:25 PDT
Created attachment 378713 [details]
Patch
Comment 4 Chris Dumez 2019-09-13 09:03:26 PDT
Created attachment 378733 [details]
Patch
Comment 5 Chris Dumez 2019-09-13 12:24:34 PDT
Created attachment 378745 [details]
Patch
Comment 6 Chris Dumez 2019-09-13 17:56:52 PDT
Comment on attachment 378745 [details]
Patch

Patch is ready for review.
Comment 7 youenn fablet 2019-09-15 02:14:02 PDT
Patch is too big for me to r+ it...
r=me anyway.

Two things to note:
1. There are several tests that use {{domains[www1]}}.
Instead, we should migrate these tests to {{hosts[alt][]}} as long as they do not care about domain hierarchy which seems to be the case.
Would be great to do that as a follow-up and upstream these changes to WPT (there is a GitHub issue on that).

2.We should probably not import imported/w3c/web-platform-tests/html/infrastructure/safe-passing-of-structured-data/shared-array-buffers
This can be skipped by updating LayoutTests/imported/w3c/resources/import-expectations.json.
Comment 8 Chris Dumez 2019-09-15 09:43:08 PDT
Created attachment 378815 [details]
Patch
Comment 9 Chris Dumez 2019-09-15 11:54:07 PDT
Created attachment 378818 [details]
Patch
Comment 10 WebKit Commit Bot 2019-09-15 12:30:08 PDT
Comment on attachment 378815 [details]
Patch

Clearing flags on attachment: 378815

Committed r249886: <https://trac.webkit.org/changeset/249886>
Comment 11 WebKit Commit Bot 2019-09-15 12:30:10 PDT
All reviewed patches have been landed.  Closing bug.
Comment 12 Radar WebKit Bug Importer 2019-09-15 12:31:28 PDT
<rdar://problem/55381542>
Comment 13 Truitt Savell 2019-09-16 08:26:48 PDT
It looks like this change in https://trac.webkit.org/changeset/249886/webkit

has broken 3 of the modified tests on Mac:

imported/w3c/web-platform-tests/html/browsers/offline/application-cache-api/api_update.https.html
imported/w3c/web-platform-tests/html/rendering/replaced-elements/embedded-content/video-controls-vertical-writing-mode.html
imported/w3c/web-platform-tests/html/browsers/offline/application-cache-api/api_swapcache_error.https.html

History:
https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fbrowsers%2Foffline%2Fapplication-cache-api%2Fapi_update.https.html%20imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Frendering%2Freplaced-elements%2Fembedded-content%2Fvideo-controls-vertical-writing-mode.html%20imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fbrowsers%2Foffline%2Fapplication-cache-api%2Fapi_swapcache_error.https.html
Comment 14 Truitt Savell 2019-09-16 08:33:22 PDT
Multiple others failing too:

imported/w3c/web-platform-tests/html/browsers/browsing-the-web/history-traversal/browsing_context_name_cross_origin_2.html
imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/module/import-meta/import-meta-url.html
Comment 15 Chris Dumez 2019-09-16 08:42:51 PDT
(In reply to Truitt Savell from comment #14)
> Multiple others failing too:
> 
> imported/w3c/web-platform-tests/html/browsers/browsing-the-web/history-
> traversal/browsing_context_name_cross_origin_2.html
> imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-
> element/module/import-meta/import-meta-url.html

Will look into it. But EWS was green so these tests could be flaky or need platform-specific expectations
Comment 16 Truitt Savell 2019-09-16 08:48:26 PDT
It doesnt look like ews ran to completion for the last patch posted.
Comment 17 Chris Dumez 2019-09-16 08:49:11 PDT
(In reply to Chris Dumez from comment #15)
> (In reply to Truitt Savell from comment #14)
> > Multiple others failing too:
> > 
> > imported/w3c/web-platform-tests/html/browsers/browsing-the-web/history-
> > traversal/browsing_context_name_cross_origin_2.html
> > imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-
> > element/module/import-meta/import-meta-url.html
> 
> Will look into it. But EWS was green so these tests could be flaky or need
> platform-specific expectations

First follow-up:
<https://trac.webkit.org/changeset/249896>
Comment 18 Chris Dumez 2019-09-16 08:49:34 PDT
(In reply to Truitt Savell from comment #16)
> It doesnt look like ews ran to completion for the last patch posted.

The last patch posted removed tests.
Comment 19 Chris Dumez 2019-09-16 08:53:57 PDT
(In reply to Chris Dumez from comment #17)
> (In reply to Chris Dumez from comment #15)
> > (In reply to Truitt Savell from comment #14)
> > > Multiple others failing too:
> > > 
> > > imported/w3c/web-platform-tests/html/browsers/browsing-the-web/history-
> > > traversal/browsing_context_name_cross_origin_2.html
> > > imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-
> > > element/module/import-meta/import-meta-url.html
> > 
> > Will look into it. But EWS was green so these tests could be flaky or need
> > platform-specific expectations
> 
> First follow-up:
> <https://trac.webkit.org/changeset/249896>

Second follow-up:
<https://trac.webkit.org/changeset/249897>
Comment 20 Chris Dumez 2019-09-16 08:58:37 PDT
(In reply to Chris Dumez from comment #19)
> (In reply to Chris Dumez from comment #17)
> > (In reply to Chris Dumez from comment #15)
> > > (In reply to Truitt Savell from comment #14)
> > > > Multiple others failing too:
> > > > 
> > > > imported/w3c/web-platform-tests/html/browsers/browsing-the-web/history-
> > > > traversal/browsing_context_name_cross_origin_2.html
> > > > imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-
> > > > element/module/import-meta/import-meta-url.html
> > > 
> > > Will look into it. But EWS was green so these tests could be flaky or need
> > > platform-specific expectations
> > 
> > First follow-up:
> > <https://trac.webkit.org/changeset/249896>
> 
> Second follow-up:
> <https://trac.webkit.org/changeset/249897>

Follow-up: <https://trac.webkit.org/changeset/249898>
Comment 21 Chris Dumez 2019-09-16 08:58:57 PDT
(In reply to Truitt Savell from comment #14)
> Multiple others failing too:
> 
> imported/w3c/web-platform-tests/html/browsers/browsing-the-web/history-
> traversal/browsing_context_name_cross_origin_2.html
> imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-
> element/module/import-meta/import-meta-url.html

Would help to get links to the failures...
Comment 22 Chris Dumez 2019-09-16 09:05:08 PDT
Follow-up:
<https://trac.webkit.org/changeset/249899>
Comment 23 Truitt Savell 2019-09-16 09:06:22 PDT
(In reply to Chris Dumez from comment #21)
> (In reply to Truitt Savell from comment #14)
> > Multiple others failing too:
> > 
> > imported/w3c/web-platform-tests/html/browsers/browsing-the-web/history-
> > traversal/browsing_context_name_cross_origin_2.html
> > imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-
> > element/module/import-meta/import-meta-url.html
> 
> Would help to get links to the failures...

imported/w3c/web-platform-tests/html/browsers/offline/application-cache-api/api_update.https.html
Crash on Mojave leaks and wk2: no crash log found
failures on other Mac queues: //build.webkit.org/results/Apple%20High%20Sierra%20Release%20WK1%20(Tests)/r249894%20(15585)/imported/w3c/web-platform-tests/html/browsers/offline/application-cache-api/api_update.https-diff.txt

imported/w3c/web-platform-tests/html/rendering/replaced-elements/embedded-content/video-controls-vertical-writing-mode.html
Image failure on Mac release: https://build.webkit.org/results/Apple%20High%20Sierra%20Release%20WK1%20(Tests)/r249894%20(15585)/imported/w3c/web-platform-tests/html/rendering/replaced-elements/embedded-content/video-controls-vertical-writing-mode-diffs.html
Crash on Mac debug: https://build.webkit.org/results/Apple%20High%20Sierra%20Debug%20WK1%20(Tests)/r249894%20(10900)/imported/w3c/web-platform-tests/html/rendering/replaced-elements/embedded-content/video-controls-vertical-writing-mode-crash-log.txt

imported/w3c/web-platform-tests/html/browsers/offline/application-cache-api/api_swapcache_error.https.html
Crashing on Mac Debug: may have been skipped previously: https://build.webkit.org/results/Apple%20High%20Sierra%20Debug%20WK2%20(Tests)/r249894%20(9489)/imported/w3c/web-platform-tests/html/browsers/offline/application-cache-api/api_swapcache_error.https-crash-log.txt
missing results, no expected file maybe?
Comment 24 Chris Dumez 2019-09-16 09:13:56 PDT
I hopefully took care of all failures as of r249899. If some failures remain after r249899, please let me know and I'll do some more gardening.