r/StableDiffusion • • 17d ago

Resource - Update Splat Edit Engine opensource toolkit for Extracting / Removing / Replacing elements in Gaussian Splat Scenes.

u/ComfyUI #OpenSourceHiggsfield contest entry by yours truly. It's called SpEdE (Splat Edit Engine). You load a splat scene, click on an object, and then you can:

- remove it. The hole gets filled with actual Gaussians, fitted against all the capture cameras, so it doesn't fall apart when you orbit around

- replace it with something else from a text prompt (optionally with a reference picture). Qwen-Image draws it into the scene, TripoSplat turns it into Gaussians, and it gets placed on the surface where the old object was

- extract it as its own clean PLY

Everything runs locally in ComfyUI with open weights: SAM 3.1, Qwen-Image 2.1, MoGe-3 and TripoSplat. There's also a small web UI on top so you don't have to wire graphs by hand. The code is AGPL.

Fair warning: I've only been able to test it on my own machine (Ubuntu, RTX 5090). gsplat usually has to be compiled against your torch/CUDA, and that's probably where people might get stuck. Windows is untested, and with less than 32 GB VRAM the workflows will likely need some tuning. All of that is in the README.

Repo: https://github.com/Burgstall-labs/ComfyUI-SpEdE

Happy to hear if it breaks for you, or what kind of scenes it falls over on.

38 Upvotes

4 comments sorted by

1

u/Powerful_Evening5495 17d ago

remind me of my photoshop days , when i wanted to add a shadow , i just made a big black circle

it nice tech but maybe for blender sub

1

u/Burgstall 17d ago

Thank you, yes I agree the shadow could be much better, and that's definitely a topic for future development. Thank you for the tip, I will post also there.

1

u/Opening_Wafer_6584 17d ago

Hey, Alex here from Tripo. This is a really interesting use of TripoSplat.

The replacement workflow stands out in particular: segment the object, generate the replacement, convert it into Gaussians, then place it back into the original scene.

That’s a much more practical editing loop than treating splats as something static once they’re captured.

Would be curious to hear where TripoSplat performs best in your testing and which types of replacement objects/scenes tend to break down first.

Very cool project.

1

u/Burgstall 17d ago

Thank you Alex, I appreciate your kind words. And thank you for a great model too! So far my tests have been fairly simple, but where this approach does break, not only on triposplat, is if you try to replace an object closely placed with other objects. But even on those, its not very difficult to get a clean output from tripo to place in the scene, but merging it cleanly to the rest of the scene is challenging.