visionOS2.0 main camera image fusion

Question

Created Jul ’24

Replies 2

Boosts 0

Participants 2

I want to align and fuse the video streams from the main camera and my external camera in visionOS 2.0, ensuring that the fused image remains directly in front of the field of view as the head moves, similar to a normal passthrough mode video image. I have already achieved and verified the static image alignment and fusion on the Vision Pro using screenshots from the main camera and the external video stream. However, I don't know how to perform real-time fusion with the main camera images. Could you please advise on how I can achieve this?

Boost

Answer 1

Kk-vision OP

Jul ’24

Is there a way in visionOS to keep the application's interface always in front of the user's view? Can someone tell me?

0

Answer 2

nataodutton OP

Sep ’24

Hello i'm sorry i can't help your problem, i'm working on accessing the main camera too but i keep getting this error :

ar_camera_frame_provider_t: Failed to start camera stream with error: <ar_error_t Error Domain=com.apple.arkit Code=100 "App not authorized.">

even though i allowed the main camera access entitlement and capability

could you maybe help me with how you got camera access ?

0