Bug 229752 – [WebXR] Support Raw Camera Access in WebXR

• Component: WebXR
• Status: NEW

Raw camera access is important for many XR usecases. The quoted text and source links below explain further.
Though this is currently a draft spec, it would be great to get the ball rolling sooner than later on supporting this in Webkit.

> Granting the camera access to the application could allow the applications to:
>
> * Take a snapshot of the AR experience along with application-rendered content. This is mostly relevant for scenarios where the camera image serves as the background for application's content (for example handheld AR).
> * Allow the application to overlay some render effects over the entire scene.
> * Provide feedback to the user about the environment they are located in. This may be particularly useful for VR headsets with available cameras (for example WMR headsets and the Flashlight feature). Note: this use case is not addressed by the current proposal - see Immersive Web CG discussions section.
> * Run custom computer vision algorithms on the data obtained from the camera texture. It may for example enable applications to semantically annotate regions of the image, for example to provide features related to accessibility.
> * Remote (server side) rendering where there is a need to sync a remotely rendered result to the camera output.

Sources:
Spec: https://immersive-web.github.io/raw-camera-access/
Explainer: https://github.com/immersive-web/raw-camera-access/blob/main/explainer.md
A github issue outlining some usecases for raw camera access: https://github.com/immersive-web/raw-camera-access/issues/7

[Radar WebKit Bug Importer]

<rdar://problem/82860481>

Any updates?