209735 2020-03-30 05:23:44 -0700 Import css/CSS2 from WPT repository 2024-07-12 18:10:46 -0700 1 1 1 Unclassified WebKit CSS WebKit Nightly Build Unspecified Unspecified NEW https://bugs.webkit.org/show_bug.cgi?id=225592 https://bugs.webkit.org/show_bug.cgi?id=251538 https://bugs.webkit.org/show_bug.cgi?id=215135 https://bugs.webkit.org/show_bug.cgi?id=263892 https://bugs.webkit.org/show_bug.cgi?id=258216 https://bugs.webkit.org/show_bug.cgi?id=258212 https://bugs.webkit.org/show_bug.cgi?id=258135 https://bugs.webkit.org/show_bug.cgi?id=243940 https://bugs.webkit.org/show_bug.cgi?id=243664 https://bugs.webkit.org/show_bug.cgi?id=269848 InRadar P2 Normal --- 1 koivisto webkit-unassigned annevk ap gsnedders jbedard karlcow m_dubet ntim ryanhaddad webkit-bug-importer oldest_to_newest 1635464 0 koivisto 2020-03-30 05:23:44 -0700 Import css/CSS2 from WPT repository 1960173 1 gsnedders 2023-06-06 17:35:08 -0700 Doing this would add ~7k new tests. Some people may have concerns about additions of this scale. 1988538 2 gsnedders 2023-10-30 09:56:28 -0700 Let's use the See Also to track regressions we've missed as a result of _not_ having these imported, because that hopefully makes it easier to justify the value of importing so many extra tests. 2015787 3 gsnedders 2024-02-21 10:15:24 -0800 (In reply to Sam Sneddon [:gsnedders] from comment #1) > Doing this would add ~7k new tests. Some people may have concerns about > additions of this scale. My ballpark estimate nine months ago was ~10–15% slowdown of overall test run time on the bots. Clearly de-duplicating our old CSS2 imports would reduce the amount this is a regression, but we currently have only ~1k from these, so it'll still be a net-regression. Additionally, our old imports are largely stored as *-expected.txt render trees, and only some of the CSS2 test suite has been converted to reftests since then — and we currently don't run visual tests for WPT tests (i.e., those we'd presumably store render trees for), so we'd potentially lose some coverage here, while gaining coverage from the more recent tests. One possible option, though it would add thousands of new lines to TestExpectations would be to import the CSS2 test suite and simply skip the (largely low value, written for the sake of getting CSS 2.1 to REC) Microsoft-authored tests. 2015788 4 webkit-bug-importer 2024-02-21 10:15:49 -0800 <rdar://problem/123388507> 2015830 5 gsnedders 2024-02-21 12:12:46 -0800 (In reply to Sam Sneddon [:gsnedders] from comment #3) > One possible option, though it would add thousands of new lines to > TestExpectations would be to import the CSS2 test suite and simply skip the > (largely low value, written for the sake of getting CSS 2.1 to REC) > Microsoft-authored tests. For reference, this would import currently mean running 1947 new tests, and skipping 5181 tests. The thought of adding >5k lines to TestExpectations (currently 7.5k lines) does not fill me with joy, however. 2016365 6 gsnedders 2024-02-23 05:38:36 -0800 https://github.com/web-platform-tests/wpt/pull/44732 gets rid of ~1k reftests (replacing them with a single testharness.js test which takes tenths of a second to run). Bug 269985 would probably also significantly decrease the test runtime for importing everything. 2046076 7 karlcow 2024-07-12 18:10:46 -0700 Sam’s PR has been merged that’s cool.