Bug 270365 - Hand tracking WebXR session in visionOS simulator
Summary: Hand tracking WebXR session in visionOS simulator
Status: RESOLVED INVALID
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebXR (show other bugs)
Version: Safari 17
Hardware: Vision Pro visionOS
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2024-03-01 11:46 PST by Daniel Rossi
Modified: 2024-03-26 22:21 PDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Daniel Rossi 2024-03-01 11:46:57 PST
There doesn't seem the ability to test hand input in the simulator to test hand input controls. 

Any of these demos will fail in visionOS as it doesn't support it. Is it possible to support it to develop controllers for it ?

https://threejs.org/examples/?q=xr#webxr_vr_handinput_pressbutton
Comment 1 Alexey Proskuryakov 2024-03-06 09:19:02 PST
Thank you for the report. Could you please clarify why you consider this to be a WebKit issue? This looks like a Simulator enhancement request to me.
Comment 2 Daniel Rossi 2024-03-06 21:36:52 PST
I've got no idea. I don't know all the source code for Webkit. Just there is no XR controller input sources for testing in the simulator. So no hand-tracking support to test features with. Can you change it to a simulator request then without closing ticket ?
Comment 3 Alexey Proskuryakov 2024-03-07 10:45:36 PST
Not really. I can copy this to Apple's internal bug tracker, but this report will need to be closed. 

I highly recommend that you file your own Feedback Assistant report instead - this way you will have the visibility into its state, and Apple engineers will be able to reach out to you if necessary.

CC'ing some people who may have deeper insight.
Comment 4 Radar WebKit Bug Importer 2024-03-08 11:47:13 PST
<rdar://problem/124288992>
Comment 5 Etienne 2024-03-19 17:07:00 PDT
This won't help for code using solely hand tracking, but Natural Input for WebXR is available in the Simulator: https://webkit.org/blog/15162/introducing-natural-input-for-webxr-in-apple-vision-pro/
Comment 6 Daniel Rossi 2024-03-26 22:21:46 PDT
I'll close this now an apparent transient-pointer input source is avail. But not sure how this works in the simulator yet. Pinch turns on this input source. Not sure what the controls are for updating the targetRaySpace. I'll figure it out and put in feedback.