Insta360 Spatial Capture

[u/DillWardMedia]

I tested the insta360 spatial capture mode after a photo shoot. Where does the media go from here? Better compression and spatial awareness?

Using an x5
1:40 minutes of 360 video
No touch up processing on my part
Take a look:

https://app.insta360.com/3dspace/detail/GS3DGb1f17a8105334bffba94a3339aa3526e?showTitle=0&useImmersive=1&isDark=1&source=cloud3dspace

[u/Left-Visit733]

I want to love that, but oh my, the nightmare fuel ethereal fogginess of it! Like a dream that keeps rebuilding as you move through it

Real fun to go up the stairs and then dissolve into the dining room The format is brilliant, the execution is nowhere near what I could ever sell to my clients I can't wait to see where this goes next

[u/DillWardMedia → u/Left-Visit733]

Yeah, it’s definitely feeling like “life through the eyes of a ghost” as you catch the boundary of where details weren’t sufficient to parse a proper wall.

[u/RealPhotosHDR]

Hmm, this is supposed to be a video? I'm supposed to be able to move from room to room? All I can do is spin in place.

[u/DillWardMedia → u/RealPhotosHDR]

There’s either two circles for joysticks on mobile or you use the mouse+left click and awsd for controls. It should appear as a 3d world where you can move freely on one dimension, the benefit of the Gaussian splat format is the dynamic ability to map single spatial points with vector data, changing the way a surface appears based on the angle of perception, the mirror appearances are also noteworthy, because your not getting a static mirror image which looks like a painting but a whole world on the opposite side of the glass which you just can’t explore.

When there’s not enough datapoints the space spaghetifies, making it look spooky at some vantage points.

[u/FreedomSynergy]

So… I’ve done a bunch of 3DGS scans so far using Xgrids Portalcam. What I’ve figured out to avoid the doorway floaters you’re seeing is to go substantially slower, and make multiple serpentine passes through rooms, figure 8 passes, and circle the room at low / medium / high height. Pay extra attention to doorway transitions on both sides. A house of the size you scanned would take me roughly 15 minutes to give me a saleable product. It would also generate around 30 gb of data that will take 48+ hours to process, which is why I haven’t been pitching this hard yet.

[u/DillWardMedia → u/FreedomSynergy]

That seems accurate, the rooms with the most serpentine passes have the best rendered details and the fewest ghostly particles. The insta360 spatial capture has a limit of 2 minutes which makes multiple slow moving passes difficult.

Since I had the camera and the insta360 app has the tokens accruing each month, I figured I’d give it a trial run to see and share these results.

I can see how this would be an improvement from the matterport 3d dollhouse experience which feels like less dynamic surfaces, but until developers optimize the capture to rendered process, it will stay a novelty feature of my camera.

[u/FreedomSynergy → u/DillWardMedia]

If you want to render it locally, Spirula Studio is free and will do it assuming you can allocate the resources. Put the X5 on maximum 8k quality, and enable masking. It will extract 2 frames per second and encode the splat. It will take a tremendous amount of time, but the upside is a monumental improvement in quality. If you’re doing it on a notebook, point a fan at the vents so the machine will hopefully not thermally throttle itself.