<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugs.webkit.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.4.1"
          urlbase="https://bugs.webkit.org/"
          
          maintainer="admin@webkit.org"
>

    <bug>
          <bug_id>198425</bug_id>
          
          <creation_ts>2019-05-31 10:22:31 -0700</creation_ts>
          <short_desc>Request: Results from run-api-tests passing iterations show entire run results similar to run-webkit-tests</short_desc>
          <delta_ts>2019-05-31 10:24:36 -0700</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>1</classification_id>
          <classification>Unclassified</classification>
          <product>WebKit</product>
          <component>Tools / Tests</component>
          <version>WebKit Nightly Build</version>
          <rep_platform>Unspecified</rep_platform>
          <op_sys>Unspecified</op_sys>
          <bug_status>NEW</bug_status>
          <resolution></resolution>
          
          <see_also>https://bugs.webkit.org/show_bug.cgi?id=197563</see_also>
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords>InRadar</keywords>
          <priority>P2</priority>
          <bug_severity>Enhancement</bug_severity>
          <target_milestone>---</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Shawn Roberts">sroberts</reporter>
          <assigned_to name="Nobody">webkit-unassigned</assigned_to>
          <cc>jbedard</cc>
    
    <cc>webkit-bot-watchers-bugzilla</cc>
    
    <cc>webkit-bug-importer</cc>
          

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>1540765</commentid>
    <comment_count>0</comment_count>
    <who name="Shawn Roberts">sroberts</who>
    <bug_when>2019-05-31 10:22:31 -0700</bug_when>
    <thetext>Currently when using run-api-tests with --iterations it will run each iteration but at the end of the run just display &quot;All tests successfully passed!&quot;. However if there was a failure/crash/timeout anywhere in the run, unless it was the most recent iteration it always displays this message. Causing you to have to scroll back through your run and see the results line by line, rather than getting the results at the end.

i.e. run-api-tests TestWebKitAPI.WKWebView.LocalStorageProcessCrashes --debug --iter 50 

Test will run and show results each Iteration.

Iteration 49
Sharding tests ...

    _RegisterApplication(), FAILED TO establish the default connection to the WindowServer, _CGSDefaultConnection() is NULL.
TestWebKitAPI.WKWebView.LocalStorageProcessCrashes Timeout
worker/0 exiting

Iteration 50
Sharding tests ...

    _RegisterApplication(), FAILED TO establish the default connection to the WindowServer, _CGSDefaultConnection() is NULL.
TestWebKitAPI.WKWebView.LocalStorageProcessCrashes Passed

Ran 1 tests of 1 with 1 successful
------------------------------
All tests successfully passed!

I think it would be helpful if it displayed results similar to run-webkit-tests with iterations.  Which will show results for all 50 iterations in one line. i.e. All 50 tests ran as expected, or x passes, x failures, x timeouts, etc.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>1540766</commentid>
    <comment_count>1</comment_count>
    <who name="Radar WebKit Bug Importer">webkit-bug-importer</who>
    <bug_when>2019-05-31 10:22:55 -0700</bug_when>
    <thetext>&lt;rdar://problem/51306056&gt;</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>