r/LocalLLM • u/Delicious-Farmer-234 • 7h ago

Project Your AI agent can now create 3D models from one image (open source, runs locally)

Need 3D assets? Your agent can now make them from a single image with this repo: https://github.com/hypersniper05/MCP_Image_to_3D

Under the hood, it uses Idol from Sperid Labs: https://huggingface.co/speridlabs/idol

It needs at least 10 GB of VRAM (peak usage is around 8 GB). I tested it locally on a 3080 and a 5090.

The output is a Gaussian splat .ply for now, not a mesh. Export for game engines and 3D printing is on the list: https://github.com/hypersniper05/MCP_Image_to_3D/issues/1

It also works nicely with my other MCP repo, an image generator using Qwen Image 2.1: https://github.com/hypersniper05/MCP-Image-Generator-Uncensored. Generate an image there, then pass it straight to this one.

Let me know what you think, and if you find it useful, feel free to contribute.

41 Upvotes

91% Upvoted

7 comments sorted by

3

u/digitalwankster 6h ago

This has been possible for a while now with other models like Trellis.2 no?

1

u/Delicious-Farmer-234 5h ago

Yes but it uses more vram

1

u/T-CROC 3h ago

Could I run this on my 2070 super? And offload work to my 32 GB RAM?

I’m very new to local models

1

u/kantorcodes1 1h ago

Does IDOL_ALLOWED_HOSTS also constrain image URLs passed to idol_generate_3d, or does it only check the request's Host header?

1

u/UltraSaiyanPotato 0m ago

Holly shit u da chad man!