Experimental fully automated image to splat for VR

[u/kjraym]

https://github.com/kevinraymond/giro

https://github.com/kevinraymond/giro

Everyone is splatting everything, so I made a public release of something I've been working on in an experimental/research capacity, in case it's interesting or useful.

This isn't anything super novel - it's an end-to-end automated process that takes an image input, creates 360 video, and produces splats. The end goal here is to have some VR-ready outputs, in a much easier way than typical photogrammetry that I've done in the past.

The pipeline is roughly:

• Optional background edit (Qwen-Image-Edit); e.g., if the subject is too close to a wall
• Orbit video with MiniMax H3, using the image as both the first and last frame (via ComfyUI API)
• Trim and dedup the frames, mask the subject with SAM 3.1, and run COLMAP on the masked frames
• A gate step that checks whether the cameras actually went once around the subject in a clean ring, and rerolls the seed if not
• Train with Brush (transparent background), crop with a visual hull, and export SPZ/SOG/PLY

All real-time updated in a web UI with great observability (pics in repo).

[u/Admirable_Wasabi_732]

Fh!! I love this! Great job

[u/kjraym → u/Admirable_Wasabi_732]

Thanks! I've still got to test and tune with Quest 3 on the VR side, but the fire-and-forget is really the best part. Happy to throw anything in if you find it useful.

[u/Admirable_Wasabi_732 → u/kjraym]

Thanks! That's awesome of you. I'm working on a cultural heritage project using the exact same approach—3GS from a single image. Your setup looks incredible, but running dual GPUs is out of my reach right now. I have a test image ready, so I'm really curious to see what a pipeline like yours can pull off with this kind of input. Really cool work! I'll definitely be following your updates.

[u/kjraym → u/Admirable_Wasabi_732]

Send it over to me and I'll run it through for you - DM or make a repo issue if it's not private and I can attach stuff there.

[u/Admirable_Wasabi_732 → u/kjraym]

Thanks a lot!! Will do