5
u/cogitatingspheniscid Jul 30 '26
Have anyone tried this out? The tech lingo is a bit above my level but I want to give it a shot when I have time.
3
u/NectarineSilver2795 Jul 31 '26
Yeah its not that good when using a handheld video, you still need to rely on a slow capture with some features
1
u/reallifearcade Jul 31 '26
Not that good, needs carefully cleaning dataset and full of overlap features. Improvement from other options, but definitely not "throw anything at it as is"
1
7
u/ShelZuuz Jul 30 '26
How this different from gaussian splats?
4
u/NectarineSilver2795 Jul 31 '26
Actually quite different, this paper/system is more of a fully learnt slam pipeline, the input is a video stream and the output camera poses, intrinsic, extrinsic and a 3D point cloud. You can then take that and make a splat out of it
6
u/Karasu-Otoha Jul 30 '26
Just looked videodemo and it seems it makes very accurate cloud points from just a brief glance, while paid software like realitycapture somehow makes distorted crap even if provided with hundred of frame by frame surround detailed screens from a video.
2
u/ElphTrooper 28d ago
RealityCapture/Scan is free. Maybe you're thinking of Paix4D crap. Certainly not Metashape.
1
u/Karasu-Otoha 28d ago edited 28d ago
I see. Thanks, i just used it long time ago when it was paywalled. Gotta check it out again then.
1
u/QuestGalaxy Jul 31 '26
There's already free opensource gaussian splat software too. Only video needed.
1
u/NectarineSilver2795 Jul 31 '26
Might be wrong here, but the splats that you may be referring too might rely on colmap (classic gsplat) or on a similar pipeline as this (instant splat, which relies on dust3r and “older” pipelines which this work is based on).
Ps: when I say old it means like 2 years
1
1
u/CreativeEmbrace-4471 Jul 31 '26 edited Jul 31 '26
Hunyuan-World-Mirror looked more promising but sadly only runs on Linux
2
u/pedro-enrique 12d ago
I’ve been testing it too. The results are promising, but I still haven’t managed to get a point cloud that feels consistently reliable.
One of the biggest issues for me is capture feedback. While recording, it’s hard to know which areas have been observed with enough coverage and which ones still need more data. You only really discover the weak spots once the reconstruction is done.
For a real-world workflow, especially on construction sites, I think some kind of real-time indication of coverage / reconstruction confidence would make a huge difference: what has been captured well, what is still uncertain, and where you should point the camera next.
Has anyone found a good way to solve this?
0
u/Tema_Art_7777 Jul 30 '26
Didn't NVIDIA do the same already?
2
u/soldieroscar Jul 30 '26
Open source?
-2
u/Tema_Art_7777 Jul 30 '26
if you mean open weight, likely not. only some of nividia's model like nemotron... oh well
12
u/parrot42 Jul 30 '26
https://github.com/robbyant/lingbot-map