Bug 209649

Summary: [WPT] Support running crash tests with run-webkit-tests
Product: WebKit Reporter: Manuel Rego Casasnovas <rego>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: RESOLVED DUPLICATE    
Severity: Normal CC: annevk, ap, ashvayka, clopez, fred.wang, gsnedders, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=186045
Bug Depends on:    
Bug Blocks: 207734    

Description Manuel Rego Casasnovas 2020-03-27 05:25:14 PDT
There are a new type of tests in WPT called crash tests: http://web-platform-tests.org/writing-tests/crashtest.html

They don't have any reference and they don't use testharness.js, basically they pass if there's no a crash (sometimes they use "test-wait" similar to reftests with "reftest-wait", see bug #186045).

It'd be nice to have support to run those tests in run-webkit-tests as we're going to end up importing some of them. Right now they are treated as pixel tests somehow, as they dump the render tree (and we know that would be different in every platform, so we'd need to skip these tests for now if they're imported).
Comment 1 Radar WebKit Bug Importer 2020-09-21 15:37:30 PDT
<rdar://problem/69332045>
Comment 2 Sam Sneddon [:gsnedders] 2020-09-24 09:30:23 PDT
*** Bug 216921 has been marked as a duplicate of this bug. ***
Comment 3 Alexey Shvayka 2022-01-25 16:41:01 PST
Ran into this in https://bugs.webkit.org/show_bug.cgi?id=235500 / https://github.com/web-platform-tests/wpt/pull/32544.

Tried linking only <script src="/resources/testharnessreport.js"></script>, didn't work out.

Sadly, imported/w3c/web-platform-tests/domxpath/xpath-evaluate-crash.html is now out-of-sync.
Comment 4 Anne van Kesteren 2023-04-04 08:42:42 PDT
I hit this with two files from WPT FileAPI. I decided not to import them when syncing in https://github.com/WebKit/WebKit/pull/12328. (I actually got confused and thought someone upstream had committed these in error.)
Comment 5 Sam Sneddon [:gsnedders] 2023-04-04 09:10:16 PDT
This was implemented in bug 242633.

*** This bug has been marked as a duplicate of bug 242633 ***