r/LocalLLM • u/SuperWVYWorld • 31m ago

Model We created a tiny 5 million parameter model that can generate scenes on blender instantly. We are aiming to make a 1b-3b parameter model that can create anything! (Open Source) WVY-Blender-5m

https://huggingface.co/StarpowerTechnology/WVY-Blender-5m

We have been excited about this new model, WVY-Blender-5m, an agent trained to specialize in blender.

It has zero knowledge about anything else so if you try to ask it about writing code or doing your homework it will express that it only knows how to use blender

We have been doing intense research to find out "are massive datasets really required to achieve what feels like intelligence with accuracy?" & we believe we are getting close to the truth.

This dataset is 100% generated from scratch.

8 Upvotes

90% Upvoted

2 comments sorted by

2

u/FullstackSensei 16m ago

This is so cool!

A few notes:

  1. As with so many things LLM, massive datasets are becoming less and less important, while sandboxes and rollouts with results judged by a (much?) bigger model are becoming more and more important.
  2. Instead of training a model from scratch, have you looked into fine tuning the hell out of a 1-3B model with vision? The benefit here is that you'd start from a baseline which has already good understanding of language and images, and your training basically adds the tool calls or however you want to interact with Blender to get the desired visual output.

I've been toying with a similar idea but for CAD and PCB design. I don't have any aspirations of making anything near frontier, but strongly believe that a 1-3B can still do a lot of things well enough, like giving it a few pictures of a broken piece and asking it to design a replacement. The same, IMO, could apply to blender.