Bug 255187

Summary: [ iOS Ventura arm64 ] 2X imported/w3c/web-platform-tests/webaudio/the-audio-api/the-audioparam-interface/ (Layout-tests) are constant text failures
Product: WebKit Reporter: Robert Jenner <jenner>
Component: Web AudioAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: cdumez, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Robert Jenner 2023-04-07 17:58:54 PDT
imported/w3c/web-platform-tests/webaudio/the-audio-api/the-audioparam-interface/k-rate-audiobuffersource-connections.html
imported/w3c/web-platform-tests/webaudio/the-audio-api/the-audioparam-interface/k-rate-dynamics-compressor-connections.html

are constant text failures on iOS 16 and macOS Ventura running Apple Silicon only. 

HISTORY:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebaudio%2Fthe-audio-api%2Fthe-audioparam-interface%2Fk-rate-audiobuffersource-connections.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebaudio%2Fthe-audio-api%2Fthe-audioparam-interface%2Fk-rate-dynamics-compressor-connections.html

These tests all appear to have started to constantly fail after we updated to macOS Ventura 13.3 and iOS 16.4


The diffs for both tests appear to be the same on both tests, and are also the same on both macOS and iOS.
DIFF URLS:
https://build.webkit.org/results/Apple-iOS-16-Simulator-Release-WK2-Tests/262718@main%20(2043)/imported/w3c/web-platform-tests/webaudio/the-audio-api/the-audioparam-interface/k-rate-audiobuffersource-connections-pretty-diff.html
https://build.webkit.org/results/Apple-iOS-16-Simulator-Release-WK2-Tests/262718@main%20(2043)/imported/w3c/web-platform-tests/webaudio/the-audio-api/the-audioparam-interface/k-rate-dynamics-compressor-connections-pretty-diff.html

TEXT DIFF:
 PASS   detune: mod.connect(tstNode[detune]) did not throw an exception.
 PASS   Expected k-rate detune AudioParam with input is not constantly 0.
 PASS   Actual k-rate detune AudioParam with input is not constantly 0.
-PASS   k-rate detune AudioParam with input equals [expected array] with an element-wise tolerance of {"absoluteThreshold":0,"relativeThreshold":0}.
-PASS < [detune] All assertions passed. (total 11 assertions)
-PASS # AUDIT TASK RUNNER FINISHED: 2 tasks ran successfully.
+FAIL X k-rate detune AudioParam with input does not equal [expected array] with an element-wise tolerance of {"absoluteThreshold":0,"relativeThreshold":0}.
+	Index	Actual			Expected		AbsError		RelError		Test threshold
+	[405]	1.120331e-1	1.120331e-1	7.450581e-9	6.650337e-8	0.000000e+0
+	[431]	1.205153e-1	1.205153e-1	7.450581e-9	6.182268e-8	0.000000e+0
+	[450]	1.267139e-1	1.267139e-1	1.490116e-8	1.175969e-7	0.000000e+0
+	[465]	1.316075e-1	1.316074e-1	1.490116e-8	1.132243e-7	0.000000e+0
+	[491]	1.400897e-1	1.400896e-1	1.490116e-8	1.063688e-7	0.000000e+0
+	...and 157 more errors.
+	Max AbsError of 5.960464e-8 at index of 1305.
+	[1305]	5.078439e-1	5.078438e-1	5.960464e-8	1.173681e-7	0.000000e+0
+	Max RelError of 1.189577e-7 at index of 787.
+	[787]	2.505288e-1	2.505288e-1	2.980232e-8	1.189577e-7	0.000000e+0
+ assert_true: expected true got false
+FAIL < [detune] 1 out of 11 assertions were failed. assert_true: expected true got false
+FAIL # AUDIT TASK RUNNER FINISHED: 1 out of 2 tasks were failed. assert_true: expected true got false
Comment 1 Radar WebKit Bug Importer 2023-04-07 17:59:27 PDT
<rdar://problem/107776216>
Comment 2 Robert Jenner 2023-04-07 18:00:31 PDT
I was able to reproduce the failures on iOS16 Release ToT running the tests as follows:

run-webkit-tests --iOS-simulator <test_goes_here>

I have marked expectations for this test for iOS here:

https://commits.webkit.org/262734@main

I will mark it for macOS while under investigation.