Bug 221499 – [ iOS 14 WK2] 5 TestWebKitAPI.GPUProcess API tests are flakey failing [webView _isPlayingAudio] checks on bot651

• Component: WebKit2
• Status: RESOLVED CONFIGURATION CHANGED

[Robert Jenner]

TestWebKitAPI.GPUProcess.CrashWhilePlayingVideo
TestWebKitAPI.GPUProcess.WebProcessTerminationAfterTooManyGPUProcessCrashes
TestWebKitAPI.GPUProcess.RelaunchOnCrash


Are flakey API failures on iOS 14 WK2 occurring on bot651 


Following the history back, the flakey failures for all 3 APIs appear to all occur on the spade spades. 

HISTORY URL:
https://results.webkit.org/?platform=ios&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.GPUProcess.RelaunchOnCrash&test=TestWebKitAPI.GPUProcess.WebProcessTerminationAfterTooManyGPUProcessCrashes&test=TestWebKitAPI.GPUProcess.WebProcessTerminationAfterTooManyGPUProcessCrashes

CRASH LOG URL:
https://build.webkit.org/builders/Apple-iOS-14-Simulator-Release-WK2-Tests/builds/1981/steps/run-api-tests/logs/json

CRASH LOG TEXT:
{
    "Failed": [
        {
            "output": "\n/Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:262\nValue of: [webView _isPlayingAudio]\n  Actual: false\nExpected: true\n\n\n/Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:282\nValue of: [webView _isPlayingAudio]\n  Actual: false\nExpected: true\n\n", 
            "name": "TestWebKitAPI.GPUProcess.CrashWhilePlayingVideo"
        }, 
        {
            "output": "ERROR: AudioOutputUnitStart() call failed with error code: -10851\nERROR: AudioOutputUnitStart() call failed with error code: -10851\n\n/Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:153\nValue of: [webView _isPlayingAudio]\n  Actual: false\nExpected: true\n\n\n/Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:222\nValue of: [webView _isPlayingAudio]\n  Actual: false\nExpected: true\n\n", 
            "name": "TestWebKitAPI.GPUProcess.WebProcessTerminationAfterTooManyGPUProcessCrashes"
        }, 
        {
            "output": "ERROR: AudioOutputUnitStart() call failed with error code: -10851\n\n/Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:97\nValue of: [webView _isPlayingAudio]\n  Actual: false\nExpected: true\n\n\n/Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:115\nValue of: [webView _isPlayingAudio]\n  Actual: false\nExpected: true\n\n", 
            "name": "TestWebKitAPI.GPUProcess.RelaunchOnCrash"
        }
    ], 
    "Timedout": [], 
    "Skipped": [], 
    "Crashed": []
}

[Radar WebKit Bug Importer]

<rdar://problem/74038728>

[Robert Jenner]

https://build.webkit.org/builders/Apple-iOS-14-Simulator-Release-WK2-Tests/builds/1980/steps/run-api-tests/logs/stdio

[Robert Jenner]

STDIO LOG URL:
https://build.webkit.org/builders/Apple-iOS-14-Simulator-Release-WK2-Tests/builds/1981/steps/run-api-tests/logs/stdio

TEXT:

TestWebKitAPI.GPUProcess.CrashWhilePlayingVideo

        /Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:262
        Value of: [webView _isPlayingAudio]
          Actual: false
        Expected: true


        /Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:282
        Value of: [webView _isPlayingAudio]
          Actual: false
        Expected: true


    TestWebKitAPI.GPUProcess.WebProcessTerminationAfterTooManyGPUProcessCrashes
        ERROR: AudioOutputUnitStart() call failed with error code: -10851
        ERROR: AudioOutputUnitStart() call failed with error code: -10851

        /Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:153
        Value of: [webView _isPlayingAudio]
          Actual: false
        Expected: true


        /Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:222
        Value of: [webView _isPlayingAudio]
          Actual: false
        Expected: true


    TestWebKitAPI.GPUProcess.RelaunchOnCrash
        ERROR: AudioOutputUnitStart() call failed with error code: -10851

        /Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:97
        Value of: [webView _isPlayingAudio]
          Actual: false
        Expected: true


        /Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:115
        Value of: [webView _isPlayingAudio]
          Actual: false
        Expected: true

[Ryan Haddad]

The current theory is that this is a bot specific issue, as we are only seeing this behavior on bot651. We also don't see it on any Apple internal bots.

TestWebKitAPI.GPUProcess.ExitsUnderMemoryPressureWebAudioNonRenderingAudioContext
TestWebKitAPI.GPUProcess.ExitsUnderMemoryPressureWebAudioCase

Are also flaky API failures/crashes on iOS 14 wk2 on bot651. It seems the tests have been passing for a while, but have started failing/crashing again at around r278398 (6/3/2021)