Bug 106031
| Summary: | NRWT: Add an ability to add crash test expectations based on stack trace | ||
|---|---|---|---|
| Product: | WebKit | Reporter: | Ryosuke Niwa <rniwa> |
| Component: | Tools / Tests | Assignee: | Nobody <webkit-unassigned> |
| Status: | NEW | ||
| Severity: | Enhancement | CC: | ap, dpranke, jberlin, lforschler, sam, simon.fraser |
| Priority: | P3 | Keywords: | NRWT |
| Version: | 528+ (Nightly build) | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
Ryosuke Niwa
We’ve had many flaky crashes and assertion failures where they could happen on any test yet share the same cause. In such a case, adding [ Crash Pass ] test expectation to all tests is not a good idea because we want to detect crashes of other kinds on those tests especially when the said crash or assertion failure could happen on any test.
Proposal: We could ignore a crash or an assertion failure based on its stack trace (i.e. signature). It’ll allow us to ignore a particular type of crash without jeopardizing our ability to detect other more reproducible crashes.
| Attachments | ||
|---|---|---|
| Add attachment proposed patch, testcase, etc. |
Dirk Pranke
interesting suggestion.
Simon Fraser (smfr)
I'd rather we just try to fix the crashes/assertions (even blindly).