NEW 198425
Request: Results from run-api-tests passing iterations show entire run results similar to run-webkit-tests 
https://bugs.webkit.org/show_bug.cgi?id=198425
Summary Request: Results from run-api-tests passing iterations show entire run result...
Shawn Roberts
Reported 2019-05-31 10:22:31 PDT
Currently when using run-api-tests with --iterations it will run each iteration but at the end of the run just display "All tests successfully passed!". However if there was a failure/crash/timeout anywhere in the run, unless it was the most recent iteration it always displays this message. Causing you to have to scroll back through your run and see the results line by line, rather than getting the results at the end. i.e. run-api-tests TestWebKitAPI.WKWebView.LocalStorageProcessCrashes --debug --iter 50 Test will run and show results each Iteration. Iteration 49 Sharding tests ... _RegisterApplication(), FAILED TO establish the default connection to the WindowServer, _CGSDefaultConnection() is NULL. TestWebKitAPI.WKWebView.LocalStorageProcessCrashes Timeout worker/0 exiting Iteration 50 Sharding tests ... _RegisterApplication(), FAILED TO establish the default connection to the WindowServer, _CGSDefaultConnection() is NULL. TestWebKitAPI.WKWebView.LocalStorageProcessCrashes Passed Ran 1 tests of 1 with 1 successful ------------------------------ All tests successfully passed! I think it would be helpful if it displayed results similar to run-webkit-tests with iterations. Which will show results for all 50 iterations in one line. i.e. All 50 tests ran as expected, or x passes, x failures, x timeouts, etc.
Attachments
Add attachment proposed patch, testcase, etc.
Radar WebKit Bug Importer
Comment 1 2019-05-31 10:22:55 PDT
<rdar://problem/51306056>
Note You need to log in before you can comment on or make changes to this bug.