<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugs.webkit.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.4.1"
          urlbase="https://bugs.webkit.org/"
          
          maintainer="admin@webkit.org"
>

    <bug>
          <bug_id>261840</bug_id>
          
          <creation_ts>2023-09-20 14:06:24 -0700</creation_ts>
          <short_desc>REGRESSION(268166@main): [ macOS ] 4 API tests under TestWebKitAPI.WKInspectorExtensionHost: 2 constantly failing, 2 constantly timing out</short_desc>
          <delta_ts>2024-04-04 19:47:26 -0700</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>1</classification_id>
          <classification>Unclassified</classification>
          <product>WebKit</product>
          <component>Web Inspector</component>
          <version>WebKit Nightly Build</version>
          <rep_platform>Unspecified</rep_platform>
          <op_sys>Unspecified</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          <see_also>https://bugs.webkit.org/show_bug.cgi?id=261717</see_also>
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords>InRadar</keywords>
          <priority>P2</priority>
          <bug_severity>Normal</bug_severity>
          <target_milestone>---</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Ben Schwartz">ben_schwartz</reporter>
          <assigned_to name="Matt Woodrow">mattwoodrow</assigned_to>
          <cc>ap</cc>
    
    <cc>inspector-bugzilla-changes</cc>
    
    <cc>mattwoodrow</cc>
    
    <cc>mishal.rehman1787</cc>
    
    <cc>webkit-bot-watchers-bugzilla</cc>
    
    <cc>webkit-bug-importer</cc>
          

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>1978773</commentid>
    <comment_count>0</comment_count>
    <who name="Ben Schwartz">ben_schwartz</who>
    <bug_when>2023-09-20 14:06:24 -0700</bug_when>
    <thetext>The following API tests are constantly failing on macOS:

TestWebKitAPI.WKInspectorExtensionHost.RegisterExtension
TestWebKitAPI.WKInspectorExtensionHost.UnegisterExtension

The following API tests are constantly timing out on macOS:

TestWebKitAPI.WKInspectorExtension.EvaluateScriptOnPage
TestWebKitAPI.WKInspectorExtension.ExtensionTabIsPersistent


ERROR LOG (for failures):

    TestWebKitAPI.WKInspectorExtensionHost.RegisterExtension
        
        /Volumes/Data/worker/Apple-Monterey-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKInspectorExtensionHost.mm:83
        Value of: error
          Actual: false
        Expected: true
        
        
        /Volumes/Data/worker/Apple-Monterey-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKInspectorExtensionHost.mm:84
        Value of: !(extension)
          Actual: false
        Expected: true
        
        
        /Volumes/Data/worker/Apple-Monterey-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKInspectorExtensionHost.mm:85
        Value of: [error.localizedFailureReason containsString:@&quot;RegistrationFailed&quot;]
          Actual: false
        Expected: true
        
    TestWebKitAPI.WKInspectorExtensionHost.UnregisterExtension
        
        /Volumes/Data/worker/Apple-Monterey-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKInspectorExtensionHost.mm:155
        Value of: error
          Actual: false
        Expected: true
        
        
        /Volumes/Data/worker/Apple-Monterey-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKInspectorExtensionHost.mm:156
        Value of: [error.localizedFailureReason containsString:@&quot;InvalidRequest&quot;]
          Actual: false
        Expected: true

STDIO URL:

https://build.webkit.org/api/v2/logs/24835290/raw

REPRODUCIBILITY:

I was able to reproduce this issue on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-api-tests --verbose TestWebKitAPI.WKInspectorExtensionHost.RegisterExtension TestWebKitAPI.WKInspectorExtensionHost.UnregisterExtension TestWebKitAPI.WKInspectorExtension.EvaluateScriptOnPage TestWebKitAPI.WKInspectorExtension.ExtensionTabIsPersistent

REGRESSION:

The flakiness dashboard, bisection, and contextual information all indicate a likely regression point at 268166@main.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>1978775</commentid>
    <comment_count>1</comment_count>
    <who name="Radar WebKit Bug Importer">webkit-bug-importer</who>
    <bug_when>2023-09-20 14:07:10 -0700</bug_when>
    <thetext>&lt;rdar://problem/115803479&gt;</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>1978818</commentid>
    <comment_count>2</comment_count>
    <who name="EWS">ews-feeder</who>
    <bug_when>2023-09-20 16:25:16 -0700</bug_when>
    <thetext>Committed 268221@main (1a475262cc73): &lt;https://commits.webkit.org/268221@main&gt;

Reviewed commits have been landed. Closing PR #17994 and removing active labels.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>1978821</commentid>
    <comment_count>3</comment_count>
    <who name="Matt Woodrow">mattwoodrow</who>
    <bug_when>2023-09-20 16:44:12 -0700</bug_when>
    <thetext>Re-opening for pull request https://github.com/WebKit/WebKit/pull/17996</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>1978828</commentid>
    <comment_count>4</comment_count>
    <who name="Alexey Proskuryakov">ap</who>
    <bug_when>2023-09-20 17:10:47 -0700</bug_when>
    <thetext>This PR is in Closed state. What is the next step for this?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>1978830</commentid>
    <comment_count>5</comment_count>
    <who name="Matt Woodrow">mattwoodrow</who>
    <bug_when>2023-09-20 17:14:50 -0700</bug_when>
    <thetext>The change has been reverted, comment 2.</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>