221499 2021-02-05 13:27:39 -0800 [ iOS 14 WK2] 5 TestWebKitAPI.GPUProcess API tests are flakey failing [webView _isPlayingAudio] checks on bot651 2022-02-11 14:25:58 -0800 1 1 1 Unclassified WebKit WebKit2 WebKit Nightly Build Unspecified Unspecified RESOLVED CONFIGURATION CHANGED https://bugs.webkit.org/show_bug.cgi?id=225475 InRadar P2 Normal --- 1 jenner webkit-unassigned ayumi_kojima bfulgham cdumez jer.noble jonlee webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1726255 0 jenner 2021-02-05 13:27:39 -0800 TestWebKitAPI.GPUProcess.CrashWhilePlayingVideo TestWebKitAPI.GPUProcess.WebProcessTerminationAfterTooManyGPUProcessCrashes TestWebKitAPI.GPUProcess.RelaunchOnCrash Are flakey API failures on iOS 14 WK2 occurring on bot651 Following the history back, the flakey failures for all 3 APIs appear to all occur on the spade spades. HISTORY URL: https://results.webkit.org/?platform=ios&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.GPUProcess.RelaunchOnCrash&test=TestWebKitAPI.GPUProcess.WebProcessTerminationAfterTooManyGPUProcessCrashes&test=TestWebKitAPI.GPUProcess.WebProcessTerminationAfterTooManyGPUProcessCrashes CRASH LOG URL: https://build.webkit.org/builders/Apple-iOS-14-Simulator-Release-WK2-Tests/builds/1981/steps/run-api-tests/logs/json CRASH LOG TEXT: { "Failed": [ { "output": "\n/Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:262\nValue of: [webView _isPlayingAudio]\n Actual: false\nExpected: true\n\n\n/Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:282\nValue of: [webView _isPlayingAudio]\n Actual: false\nExpected: true\n\n", "name": "TestWebKitAPI.GPUProcess.CrashWhilePlayingVideo" }, { "output": "ERROR: AudioOutputUnitStart() call failed with error code: -10851\nERROR: AudioOutputUnitStart() call failed with error code: -10851\n\n/Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:153\nValue of: [webView _isPlayingAudio]\n Actual: false\nExpected: true\n\n\n/Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:222\nValue of: [webView _isPlayingAudio]\n Actual: false\nExpected: true\n\n", "name": "TestWebKitAPI.GPUProcess.WebProcessTerminationAfterTooManyGPUProcessCrashes" }, { "output": "ERROR: AudioOutputUnitStart() call failed with error code: -10851\n\n/Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:97\nValue of: [webView _isPlayingAudio]\n Actual: false\nExpected: true\n\n\n/Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:115\nValue of: [webView _isPlayingAudio]\n Actual: false\nExpected: true\n\n", "name": "TestWebKitAPI.GPUProcess.RelaunchOnCrash" } ], "Timedout": [], "Skipped": [], "Crashed": [] } 1726256 1 webkit-bug-importer 2021-02-05 13:28:02 -0800 <rdar://problem/74038728> 1726267 2 jenner 2021-02-05 14:03:22 -0800 https://build.webkit.org/builders/Apple-iOS-14-Simulator-Release-WK2-Tests/builds/1980/steps/run-api-tests/logs/stdio 1726272 3 jenner 2021-02-05 14:16:40 -0800 STDIO LOG URL: https://build.webkit.org/builders/Apple-iOS-14-Simulator-Release-WK2-Tests/builds/1981/steps/run-api-tests/logs/stdio TEXT: TestWebKitAPI.GPUProcess.CrashWhilePlayingVideo /Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:262 Value of: [webView _isPlayingAudio] Actual: false Expected: true /Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:282 Value of: [webView _isPlayingAudio] Actual: false Expected: true TestWebKitAPI.GPUProcess.WebProcessTerminationAfterTooManyGPUProcessCrashes ERROR: AudioOutputUnitStart() call failed with error code: -10851 ERROR: AudioOutputUnitStart() call failed with error code: -10851 /Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:153 Value of: [webView _isPlayingAudio] Actual: false Expected: true /Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:222 Value of: [webView _isPlayingAudio] Actual: false Expected: true TestWebKitAPI.GPUProcess.RelaunchOnCrash ERROR: AudioOutputUnitStart() call failed with error code: -10851 /Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:97 Value of: [webView _isPlayingAudio] Actual: false Expected: true /Volumes/Data/slave/ios-simulator-14-release/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/GPUProcess.mm:115 Value of: [webView _isPlayingAudio] Actual: false Expected: true 1726760 4 ryanhaddad 2021-02-08 13:14:46 -0800 The current theory is that this is a bot specific issue, as we are only seeing this behavior on bot651. We also don't see it on any Apple internal bots. 1776944 5 ayumi_kojima 2021-07-14 09:05:03 -0700 TestWebKitAPI.GPUProcess.ExitsUnderMemoryPressureWebAudioNonRenderingAudioContext TestWebKitAPI.GPUProcess.ExitsUnderMemoryPressureWebAudioCase Are also flaky API failures/crashes on iOS 14 wk2 on bot651. It seems the tests have been passing for a while, but have started failing/crashing again at around r278398 (6/3/2021)