<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugs.webkit.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.4.1"
          urlbase="https://bugs.webkit.org/"
          
          maintainer="admin@webkit.org"
>

    <bug>
          <bug_id>297751</bug_id>
          
          <creation_ts>2025-08-21 14:58:37 -0700</creation_ts>
          <short_desc>[WPE][GTK] API test runner: allow to pass a list of tests and subtests to run</short_desc>
          <delta_ts>2025-08-22 04:49:33 -0700</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>1</classification_id>
          <classification>Unclassified</classification>
          <product>WebKit</product>
          <component>Tools / Tests</component>
          <version>WebKit Nightly Build</version>
          <rep_platform>Unspecified</rep_platform>
          <op_sys>Unspecified</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords>InRadar</keywords>
          <priority>P2</priority>
          <bug_severity>Normal</bug_severity>
          <target_milestone>---</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Carlos Alberto Lopez Perez">clopez</reporter>
          <assigned_to name="Carlos Alberto Lopez Perez">clopez</assigned_to>
          <cc>webkit-bug-importer</cc>
          

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>2138099</commentid>
    <comment_count>0</comment_count>
    <who name="Carlos Alberto Lopez Perez">clopez</who>
    <bug_when>2025-08-21 14:58:37 -0700</bug_when>
    <thetext>We have detected that the EWS API-Tests bots for GTK and WPE are not running properly.

The issue is that https://commits.webkit.org/288955@main introduced an optimization on the buildbot code, so that the retry steps (with patch and without it) instead of running all the available tests only re-run the tests that failed on the initial step (running all the tests).

That makes sense, the problem is that the API Test runner for GTK and WPE doesn&apos;t accept specifying more than one subtest to run. Is either run all or run only one subtest.

So this is causing the bots to get totally confused and always report the tests that failed on the first step as new failures introduced by the patch.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>2138105</commentid>
    <comment_count>1</comment_count>
    <who name="Carlos Alberto Lopez Perez">clopez</who>
    <bug_when>2025-08-21 15:25:01 -0700</bug_when>
    <thetext>Pull request: https://github.com/WebKit/WebKit/pull/49734</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>2138210</commentid>
    <comment_count>2</comment_count>
    <who name="EWS">ews-feeder</who>
    <bug_when>2025-08-22 04:46:53 -0700</bug_when>
    <thetext>Committed 299049@main (c0eac65a0733): &lt;https://commits.webkit.org/299049@main&gt;

Reviewed commits have been landed. Closing PR #49734 and removing active labels.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>2138213</commentid>
    <comment_count>3</comment_count>
    <who name="Radar WebKit Bug Importer">webkit-bug-importer</who>
    <bug_when>2025-08-22 04:49:33 -0700</bug_when>
    <thetext>&lt;rdar://problem/158937479&gt;</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>