Bug 255187 - [ iOS Ventura arm64 ] 2X imported/w3c/web-platform-tests/webaudio/the-audio-api/the-audioparam-interface/ (Layout-tests) are constant text failures
Summary: [ iOS Ventura arm64 ] 2X imported/w3c/web-platform-tests/webaudio/the-audio-a...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Web Audio (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2023-04-07 17:58 PDT by Robert Jenner
Modified: 2023-04-07 18:00 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2023-04-07 17:58:54 PDT
imported/w3c/web-platform-tests/webaudio/the-audio-api/the-audioparam-interface/k-rate-audiobuffersource-connections.html
imported/w3c/web-platform-tests/webaudio/the-audio-api/the-audioparam-interface/k-rate-dynamics-compressor-connections.html

are constant text failures on iOS 16 and macOS Ventura running Apple Silicon only. 

HISTORY:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebaudio%2Fthe-audio-api%2Fthe-audioparam-interface%2Fk-rate-audiobuffersource-connections.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebaudio%2Fthe-audio-api%2Fthe-audioparam-interface%2Fk-rate-dynamics-compressor-connections.html

These tests all appear to have started to constantly fail after we updated to macOS Ventura 13.3 and iOS 16.4


The diffs for both tests appear to be the same on both tests, and are also the same on both macOS and iOS.
DIFF URLS:
https://build.webkit.org/results/Apple-iOS-16-Simulator-Release-WK2-Tests/262718@main%20(2043)/imported/w3c/web-platform-tests/webaudio/the-audio-api/the-audioparam-interface/k-rate-audiobuffersource-connections-pretty-diff.html
https://build.webkit.org/results/Apple-iOS-16-Simulator-Release-WK2-Tests/262718@main%20(2043)/imported/w3c/web-platform-tests/webaudio/the-audio-api/the-audioparam-interface/k-rate-dynamics-compressor-connections-pretty-diff.html

TEXT DIFF:
 PASS   detune: mod.connect(tstNode[detune]) did not throw an exception.
 PASS   Expected k-rate detune AudioParam with input is not constantly 0.
 PASS   Actual k-rate detune AudioParam with input is not constantly 0.
-PASS   k-rate detune AudioParam with input equals [expected array] with an element-wise tolerance of {"absoluteThreshold":0,"relativeThreshold":0}.
-PASS < [detune] All assertions passed. (total 11 assertions)
-PASS # AUDIT TASK RUNNER FINISHED: 2 tasks ran successfully.
+FAIL X k-rate detune AudioParam with input does not equal [expected array] with an element-wise tolerance of {"absoluteThreshold":0,"relativeThreshold":0}.
+	Index	Actual			Expected		AbsError		RelError		Test threshold
+	[405]	1.120331e-1	1.120331e-1	7.450581e-9	6.650337e-8	0.000000e+0
+	[431]	1.205153e-1	1.205153e-1	7.450581e-9	6.182268e-8	0.000000e+0
+	[450]	1.267139e-1	1.267139e-1	1.490116e-8	1.175969e-7	0.000000e+0
+	[465]	1.316075e-1	1.316074e-1	1.490116e-8	1.132243e-7	0.000000e+0
+	[491]	1.400897e-1	1.400896e-1	1.490116e-8	1.063688e-7	0.000000e+0
+	...and 157 more errors.
+	Max AbsError of 5.960464e-8 at index of 1305.
+	[1305]	5.078439e-1	5.078438e-1	5.960464e-8	1.173681e-7	0.000000e+0
+	Max RelError of 1.189577e-7 at index of 787.
+	[787]	2.505288e-1	2.505288e-1	2.980232e-8	1.189577e-7	0.000000e+0
+ assert_true: expected true got false
+FAIL < [detune] 1 out of 11 assertions were failed. assert_true: expected true got false
+FAIL # AUDIT TASK RUNNER FINISHED: 1 out of 2 tasks were failed. assert_true: expected true got false
Comment 1 Radar WebKit Bug Importer 2023-04-07 17:59:27 PDT
<rdar://problem/107776216>
Comment 2 Robert Jenner 2023-04-07 18:00:31 PDT
I was able to reproduce the failures on iOS16 Release ToT running the tests as follows:

run-webkit-tests --iOS-simulator <test_goes_here>

I have marked expectations for this test for iOS here:

https://commits.webkit.org/262734@main

I will mark it for macOS while under investigation.