Bug 198425
Summary: | Request: Results from run-api-tests passing iterations show entire run results similar to run-webkit-tests | ||
---|---|---|---|
Product: | WebKit | Reporter: | Shawn Roberts <sroberts> |
Component: | Tools / Tests | Assignee: | Nobody <webkit-unassigned> |
Status: | NEW | ||
Severity: | Enhancement | CC: | jbedard, webkit-bot-watchers-bugzilla, webkit-bug-importer |
Priority: | P2 | Keywords: | InRadar |
Version: | WebKit Nightly Build | ||
Hardware: | Unspecified | ||
OS: | Unspecified | ||
See Also: | https://bugs.webkit.org/show_bug.cgi?id=197563 |
Shawn Roberts
Currently when using run-api-tests with --iterations it will run each iteration but at the end of the run just display "All tests successfully passed!". However if there was a failure/crash/timeout anywhere in the run, unless it was the most recent iteration it always displays this message. Causing you to have to scroll back through your run and see the results line by line, rather than getting the results at the end.
i.e. run-api-tests TestWebKitAPI.WKWebView.LocalStorageProcessCrashes --debug --iter 50
Test will run and show results each Iteration.
Iteration 49
Sharding tests ...
_RegisterApplication(), FAILED TO establish the default connection to the WindowServer, _CGSDefaultConnection() is NULL.
TestWebKitAPI.WKWebView.LocalStorageProcessCrashes Timeout
worker/0 exiting
Iteration 50
Sharding tests ...
_RegisterApplication(), FAILED TO establish the default connection to the WindowServer, _CGSDefaultConnection() is NULL.
TestWebKitAPI.WKWebView.LocalStorageProcessCrashes Passed
Ran 1 tests of 1 with 1 successful
------------------------------
All tests successfully passed!
I think it would be helpful if it displayed results similar to run-webkit-tests with iterations. Which will show results for all 50 iterations in one line. i.e. All 50 tests ran as expected, or x passes, x failures, x timeouts, etc.
Attachments | ||
---|---|---|
Add attachment proposed patch, testcase, etc. |
Radar WebKit Bug Importer
<rdar://problem/51306056>