Bug 205872 - [CSS Backgrounds] Import WPT css-backgrounds tests
Summary: [CSS Backgrounds] Import WPT css-backgrounds tests
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Carlos Alberto Lopez Perez
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-01-07 11:04 PST by Carlos Alberto Lopez Perez
Modified: 2020-02-13 17:32 PST (History)
8 users (show)

See Also:


Attachments
Patch (3.13 MB, patch)
2020-01-07 12:06 PST, Carlos Alberto Lopez Perez
no flags Details | Formatted Diff | Diff
Patch (3.13 MB, patch)
2020-01-21 10:01 PST, Carlos Alberto Lopez Perez
no flags Details | Formatted Diff | Diff
Patch (3.16 MB, patch)
2020-01-23 18:58 PST, Carlos Alberto Lopez Perez
no flags Details | Formatted Diff | Diff
Patch (3.16 MB, patch)
2020-01-24 09:32 PST, Carlos Alberto Lopez Perez
no flags Details | Formatted Diff | Diff
Patch (3.16 MB, patch)
2020-01-27 14:24 PST, Carlos Alberto Lopez Perez
no flags Details | Formatted Diff | Diff
Patch (3.16 MB, patch)
2020-01-28 07:16 PST, Carlos Alberto Lopez Perez
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Carlos Alberto Lopez Perez 2020-01-07 11:04:12 PST
Import WPT css/css-backgrounds
Comment 1 Carlos Alberto Lopez Perez 2020-01-07 12:06:13 PST
Created attachment 387012 [details]
Patch

Test EWS
Comment 2 Carlos Alberto Lopez Perez 2020-01-21 10:01:15 PST
Created attachment 388314 [details]
Patch

test EWS
Comment 3 Carlos Alberto Lopez Perez 2020-01-23 18:58:00 PST
Created attachment 388643 [details]
Patch

test EWS
Comment 4 Carlos Alberto Lopez Perez 2020-01-24 09:32:53 PST
Created attachment 388702 [details]
Patch
Comment 5 Simon Fraser (smfr) 2020-01-24 11:50:12 PST
I think last time I tried this, I wanted to fix https://bugs.webkit.org/show_bug.cgi?id=204469 first.
Comment 6 Simon Fraser (smfr) 2020-01-24 13:02:52 PST
(In reply to Simon Fraser (smfr) from comment #5)
> I think last time I tried this, I wanted to fix
> https://bugs.webkit.org/show_bug.cgi?id=204469 first.

Specifically, I think I saw problems where a ref test had a relative URL to another resource, and copying it to -expected.html broke those relative links.
Comment 7 Carlos Alberto Lopez Perez 2020-01-27 12:04:21 PST
(In reply to Simon Fraser (smfr) from comment #6)
> (In reply to Simon Fraser (smfr) from comment #5)
> > I think last time I tried this, I wanted to fix
> > https://bugs.webkit.org/show_bug.cgi?id=204469 first.
> 
> Specifically, I think I saw problems where a ref test had a relative URL to
> another resource, and copying it to -expected.html broke those relative
> links.

was this maybe bug 203789 ? I commented there

I have checked this more carefully and the test importer does rewrites of the resources pointed by the ref-tests so relative path URLs should continue to work (in theory), but in practice I already found a few cases where it didn't did what it should. I will try to fix this corner cases I found now on the test-importer-rewriter, but ideally we should fix bug 203784 and stop doing rewrites.
Comment 8 Carlos Alberto Lopez Perez 2020-01-27 14:24:01 PST
Created attachment 388909 [details]
Patch

Updated patch after re-importing with fix from bug 206842 . Diff: http://sprunge.us/u8qed4?diff
Comment 9 WebKit Commit Bot 2020-01-28 06:07:13 PST
Comment on attachment 388909 [details]
Patch

Rejecting attachment 388909 [details] from commit-queue.

Failed to run "['/Volumes/Data/EWS/WebKit/Tools/Scripts/webkit-patch', '--status-host=webkit-queues.webkit.org', '--bot-id=webkit-cq-01', 'apply-attachment', '--no-update', '--non-interactive', 388909, '--port=mac']" exit_code: 2 cwd: /Volumes/Data/EWS/WebKit

Last 5000 characters of output:

patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/border-width-invalid-expected.txt
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/border-width-invalid.html
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/border-width-shorthand-expected.txt
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/border-width-shorthand.html
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/border-width-valid-expected.txt
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/border-width-valid.html
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/box-shadow-computed-expected.txt
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/box-shadow-computed.html
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/box-shadow-invalid-expected.txt
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/box-shadow-invalid.html
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/box-shadow-valid-expected.txt
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/box-shadow-valid.html
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/parsing/w3c-import.log
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/resources/w3c-import.log
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/scroll-positioned-multiple-background-images-expected.html
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/scroll-positioned-multiple-background-images.html
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/support/a-green.css
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/support/b-green.css
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/support/c-red.css
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/support/import-green.css
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/support/import-red.css
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/support/w3c-import.log
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/table-cell-background-local-expected.html
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/table-cell-background-local.html
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-css3background-border-color-shorthand-missing-bottom.htm
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-css3background-border-color-shorthand-missing-left.htm
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-css3background-border-color-shorthand-missing-right.htm
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-css3background-border-color-shorthand.htm
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-css3background-border-color.htm
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-css3background-border-style-double.htm
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-css3background-border-style-shorthand-missing-bottom.htm
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-css3background-border-style-shorthand-missing-left.htm
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-css3background-border-style-shorthand.htm
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-css3background-border-style-values.htm
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-css3background-border-style.htm
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-reftest-borderRadius-expected.html
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/ttwf-reftest-borderRadius.html
patching file LayoutTests/imported/w3c/web-platform-tests/css/css-backgrounds/w3c-import.log
patching file LayoutTests/platform/gtk/TestExpectations
patching file LayoutTests/platform/ios/TestExpectations
Hunk #1 FAILED at 3463.
1 out of 1 hunk FAILED -- saving rejects to file LayoutTests/platform/ios/TestExpectations.rej
patching file LayoutTests/platform/ios/imported/w3c/web-platform-tests/css/css-backgrounds/animations/border-width-interpolation-expected.txt
patching file LayoutTests/platform/wpe/TestExpectations

Failed to run "[u'/Volumes/Data/EWS/WebKit/Tools/Scripts/svn-apply', '--force', '--reviewer', u'Simon Fraser']" exit_code: 1 cwd: /Volumes/Data/EWS/WebKit

Full output: https://webkit-queues.webkit.org/results/13312690
Comment 10 Carlos Alberto Lopez Perez 2020-01-28 07:16:25 PST
Created attachment 388990 [details]
Patch

Rebased patch for landing
Comment 11 WebKit Commit Bot 2020-01-28 08:49:20 PST
Comment on attachment 388990 [details]
Patch

Clearing flags on attachment: 388990

Committed r255239: <https://trac.webkit.org/changeset/255239>
Comment 12 WebKit Commit Bot 2020-01-28 08:49:21 PST
All reviewed patches have been landed.  Closing bug.
Comment 13 Radar WebKit Bug Importer 2020-01-28 08:50:18 PST
<rdar://problem/58956663>
Comment 14 Truitt Savell 2020-01-28 11:03:25 PST
This seems to have introduced several flaky crashes:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-backgrounds%2Fbackground-size%2Fvector%2Ftall--auto-32px--nonpercent-width-omitted-height-viewbox.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-backgrounds%2Fbackground-size%2Fvector%2Ftall--auto-32px--nonpercent-width-omitted-height.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-backgrounds%2Fbackground-size%2Fvector%2Ftall--auto-32px--nonpercent-width-percent-height-viewbox.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-backgrounds%2Fbackground-size%2Fvector%2Ftall--auto-32px--nonpercent-width-percent-height.html

imported/w3c/web-platform-tests/css/css-backgrounds/background-size/vector/tall--auto-32px--nonpercent-width-omitted-height-viewbox.html
imported/w3c/web-platform-tests/css/css-backgrounds/background-size/vector/tall--auto-32px--nonpercent-width-percent-height.html
imported/w3c/web-platform-tests/css/css-backgrounds/background-size/vector/tall--auto-32px--nonpercent-width-percent-height-viewbox.html
imported/w3c/web-platform-tests/css/css-backgrounds/background-size/vector/tall--auto-32px--nonpercent-width-omitted-height.html
Comment 16 Carlos Alberto Lopez Perez 2020-01-28 11:13:48 PST
(In reply to Truitt Savell from comment #15)
> Results page:
> https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/
> r255241%20(1971)/results.html

I see.

Those are expected failures, but on Debug its crashing.

I will try to land a gardening patch updating those
Comment 17 Carlos Alberto Lopez Perez 2020-01-28 11:26:41 PST
(In reply to Carlos Alberto Lopez Perez from comment #16)
> (In reply to Truitt Savell from comment #15)
> > Results page:
> > https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/
> > r255241%20(1971)/results.html
> 
> I see.
> 
> Those are expected failures, but on Debug its crashing.
> 
> I will try to land a gardening patch updating those

Done in https://trac.webkit.org/changeset/255265

assigned bug 206897
Comment 18 Truitt Savell 2020-01-28 13:48:38 PST
I followed up with more specific expectations. due to duplication in LayoutTests/expectations these expectations would not be respected properly. 

https://trac.webkit.org/changeset/255274/webkit