VisionOS slow image tracking and enterprise API questions

Hi @brother_z

TLDR - none of the approaches you referenced will help you track images at a higher refresh rate. I encourage you to file an enhancement request for this feature using feedback assistant. Be sure to explain your use case.

If your use case qualifies for enterprise APIs, you can use Main camera access to obtain the camera frames then feed those to a Core ML model to detect the images. I realize this isn't trivial and I haven't tried it myself, but I want you to have all the options.

Answers to your exact questions inline.

Is it possible to request Enterprise API access as a single person with basic Apple Developer subscription? I looked around the forum and only got more confused.

There's no company size requirement to obtain access to enterprise APIs. The evaluation process considers your use case. For more information, including how to apply for this entitlement, see Building spatial experiences for business apps with enterprise APIs for visionOS.

Does QR code detection and tracking work any better than image detection, or anchor updates are the same?

No, QR code and barcode scanning has a low refresh rate.

Does the increased "object detection" frequency affect in any way image/QR tracking, or is it (as name implies) only for object tracking?

You are correct, this only affects object tracking.

Would increasing the CPU/GPU headroom make any change to image/QR detection frequency?

No

Is there something to disable to make anchor updates more frequent? I don't need complex models, shadows, physics, etc

No

Thanks for answering all my questions.

I did submit a feedback through assistant (FB15332348), but for now it means I'll have to "do something" :).

The CoreML approach could be a way, but it'll take time to get to the quality of tracking Apple provides on iOS. Also it feels that VP's cameras have problems with tracking of smaller images - I see that they fail to track at around 30cm, while iPhone works a few times farther (with perfect light conditions). So it's possible that even @60Hz it would still not help me to do what I need.

Now I'm trying to play with object tracking, although what I need to track is quite small with rather boring and uniform textures. But if that would work, then the "higher object tracking frequency" from Enterprise API might be helpful.

I really love what VP can do, but I hate as much some limitations it currently has ;).

@Vision Pro Engineer - a small update. There is some sort of company size requirement, as my individual developer account, when I click on the development only request link says

You must be the Account Holder of an Apple Developer Program for Organizations or an Apple Developer Enterprise Program to view this page.

Is there someone I can contact about this?

For anyone that would find this thread while looking for same answers:

after some conversations with Apple support - size of company doesn't matter as long as it qualifies for company, or enterprise account. So in case of single person, or a small company (that is not a legal entity) it doesn't work, because in both cases you can get only individual account and this account can't apply for enterprise API.

So the answer to my question

Is it possible to request Enterprise API access as a single person with basic Apple Developer subscription?

is: nope.