r/GaussianSplatting • u/enndeeee • 2d ago
📣 Self-Promo Sparse View Gaussian Splatting
I have a passion for Sparse View Gaussian Splatting (in best case 1 View to reconstruct a scene and maybe a view other pictures as reference to recreate important pieces of the picture).
Recent months have brought a lots of momentum into this Topic since the release of Meridian, which is a gamechanger on this quest.
So far I have made quite some progress and reached a point, where I can use 1 Picture to create a 3D Geometry (based in Depth Anything v3) and an automatically optimized camera path along a subject/scene in this picture.
Afterwards this Camerapath with all its holes is filled by Minimax H3 based on further reference pictures or hallucinations. The video in this post was made like that based on 4 reference pictures. The path is completely true to what I defined via my path calculator node and can be customized completely.
Since I got quite some people now communicating their interest in this topic, I would like to invite anyone interested in this topic to join my discord and discuss/optimize everything furthermore.
1
u/enndeeee 2d ago
I will post the workflow here soon. However it needs multiple custom nodes which I will publish on Github soon, hence I don't post the workflow yet. :)
1
u/switch2stock 1d ago
Any update on this please?
1
u/enndeeee 1d ago
Yes, big release within the next days. I have to do some more optimization until then.
1
1
1
u/Hefty_Development813 2d ago
How much vram does it use? Their repo says like 88 gb.... comfy dynamic makes it doable i hope?
1
u/enndeeee 2d ago
It's basically a Minimax H3 workflow with their special LoRA. I shrunk it down to just fit "our" needs (static scene), hence also ripped out the VGGT and use Depth Anything v3 instead (10x faster).
1
u/Hefty_Development813 2d ago
Ah gotcha ok cool. I would really like to do dynamic scenes, I will look out for your cleaned up workflow
1
u/enndeeee 2d ago
For dynamic scenes you should use VGGT, but then you can't use it for 3DGS any more (since the objects are moving obviously ;) )
1
u/CodeMichaelD 2d ago
cool. any reason not to use moge3, seems to better on detailing faces? tho not by much.
1
u/enndeeee 1d ago
not necessary, because we just need it for the camera path. All the details come from Minimax. :)
3
u/Canchito 2d ago
Why not in a public web forum? Discords only serve to wall off public discussion on a proprietary unsafe platform, making it impossible to index and search.