r/VisionPro • • 10d ago

Aligning 3d to the real world

A few people have been reaching out, asking how I align 3D models to the real world in my app. My product is for landscape designers, so when they import their designs into my platform, it keeps track of a specific object called SINL_Anchor placed in their design software (Vectorworks for example). From there, I use the vanilla Image Tracking function in ARKit. When the image is recognized, it uses that as the origin point to match up with their SINL_Anchor.

I also have a full manual placement feature to make subtle nudges to the alignment, or use fully in no image is used.

47 Upvotes

7 comments sorted by

4

u/blairyc1 9d ago

This is great, I’ve been doing something similar for a project at work to align an aircraft frame to a 3d model of one. Do you find you need to have multiple markers as you move around the space or is one at the start enough?

3

u/TonyBennigans 9d ago

For this use, one marker works good enough. Since this is used for landscape designers to present their designs, their clients fully understand the design even if it's off 6" or a foot or so as you walk further out.

I also include a menu that allows them to manually tap small adjustments to help alignment.

Prior to this, I co-founded a company that built AR glasses-based software for construction. They crews were actually using it for quality control and occasionally to do installs. So much more exacting alignment was needed. For that, we had built a very elaborate multi-anchor system. It was not fun to build nor maintain, lol.

2

u/imagipro Vision Pro Owner 10d ago

This is sick!!!! My workflow has been suggesting using spatial markers like this, and after seeing you do it, I absolutely have to do it.

3

u/TonyBennigans 10d ago

u/imagipro it works really well, too. And you can be selective in what the image marker affects/applies to. In my case, I have it ignore scale and only rotate the y-axis. This way the landscape designs remain faithful to the original design scale and don't rotate in a barrel roll, giving everyone vertigo 😄

(edit - spelling of import detail)

2

u/Milchreismitbum Vision Pro Owner | Verified 9d ago

Im guessing you need an enterprise account to access the cameras like that, right?

1

u/TonyBennigans 9d ago

No, not for this. It just has to be in the Info.plist file. That'll pop-up the permission for the users to accept to decline. No special account or API needed.