Bug 209649 - [WPT] Support running crash tests with run-webkit-tests
Summary: [WPT] Support running crash tests with run-webkit-tests
Status: RESOLVED DUPLICATE of bug 242633
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
: 216921 (view as bug list)
Depends on:
Blocks: 207734
  Show dependency treegraph
 
Reported: 2020-03-27 05:25 PDT by Manuel Rego Casasnovas
Modified: 2023-04-04 09:10 PDT (History)
7 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Manuel Rego Casasnovas 2020-03-27 05:25:14 PDT
There are a new type of tests in WPT called crash tests: http://web-platform-tests.org/writing-tests/crashtest.html

They don't have any reference and they don't use testharness.js, basically they pass if there's no a crash (sometimes they use "test-wait" similar to reftests with "reftest-wait", see bug #186045).

It'd be nice to have support to run those tests in run-webkit-tests as we're going to end up importing some of them. Right now they are treated as pixel tests somehow, as they dump the render tree (and we know that would be different in every platform, so we'd need to skip these tests for now if they're imported).
Comment 1 Radar WebKit Bug Importer 2020-09-21 15:37:30 PDT
<rdar://problem/69332045>
Comment 2 Sam Sneddon [:gsnedders] 2020-09-24 09:30:23 PDT
*** Bug 216921 has been marked as a duplicate of this bug. ***
Comment 3 Alexey Shvayka 2022-01-25 16:41:01 PST
Ran into this in https://bugs.webkit.org/show_bug.cgi?id=235500 / https://github.com/web-platform-tests/wpt/pull/32544.

Tried linking only <script src="/resources/testharnessreport.js"></script>, didn't work out.

Sadly, imported/w3c/web-platform-tests/domxpath/xpath-evaluate-crash.html is now out-of-sync.
Comment 4 Anne van Kesteren 2023-04-04 08:42:42 PDT
I hit this with two files from WPT FileAPI. I decided not to import them when syncing in https://github.com/WebKit/WebKit/pull/12328. (I actually got confused and thought someone upstream had committed these in error.)
Comment 5 Sam Sneddon [:gsnedders] 2023-04-04 09:10:16 PDT
This was implemented in bug 242633.

*** This bug has been marked as a duplicate of bug 242633 ***