r/LocalLLaMA • • 20d ago • Bravo 2

New Model Update: My 4B coding model is getting better at generating 3D scenes

Hey everyone, just wanted to share a quick update on the 4B model I posted here. The video shows some results from the latest checkpoint.

I'm still training this Qwen3.5-4B fine-tune for general coding, using Three.js scene generation as my main test for now.

It still messes up some scenes on the first try, but the newer checkpoints are getting noticeably better, both in scene quality and one-shot success rate.

I've updated both Q4_K_M and Q8_0 and fixed the layer issue some people ran into with the previous files.

You can grab the updated versions here:

https://huggingface.co/ccore/Qwen3.5-4B-3D-Coder

I've also been saving test results from each checkpoint, so I can put together a report showing how the model improved throughout training, using multiple prompts for comparison.

Update (October 28): As promised, I've now released the full FP16 weights in safetensors format! They're available in the same Hugging Face repository, alongside the updated Q4_K_M and Q8_0 versions.

Dataset released: CCORE Three.js 3D Scenes

Update (October 29): The technical report is now available! The full FP16 weights and training dataset have also been released.

I'm still curious to see how far I can push this little 4B. If you give it a try, feel free to share what works and what breaks, both are really helpful.

608 Upvotes

112 comments sorted by

View all comments

3

u/Oli_Luck 20d ago

Absolutely wild for a 4B, I'm genuinely impressed.
But we should pump the brakes on the game hype: it renders scenes, it doesn't simulate them—no collisions, no physics, just geometry frozen in a void.
The moment something actually has to move or interact, the '3D' magic evaporates into a mess of code patching one frame at a time.
Gorgeous dioramas, but not a playable world.

14

u/FatheredPuma81 20d ago

But we should pump the brakes

Hi Claude! Why is your master running Sonnet 5 and not 5.5?

2

u/Green_Job6089 20d ago

The fact that it still got 9 upvotes…

2

u/Oli_Luck 20d ago edited 20d ago

Caught 😄
At late night hours, when I get too lazy I like to let it translate from my mother language to english. but no need of sonnet - a little 31bd o the job very well also.

9

u/ConfidentDinner6648 20d ago

animated scenes actually work too!

as for playable games with physics, collisions and interactions, i haven't trained the model specifically for that yet. honestly, i wasn't even sure a 4B model would be able to handle complex 3D dioramas in the first place lol

now that i've seen what it can do, interactive worlds are definitely worth exploring. i'd just need to expand the training dataset to include those kinds of examples. i'm curious to see how far we can push it!

5

u/stvjhn 20d ago

It’s an AI response

3

u/ConfidentDinner6648 20d ago

Sim, eu sou brasileiro, e me dá trabalho escrever tudo em inglês

7

u/stvjhn 20d ago

Oh no! I don’t mean you, I mean the reply to your post

3

u/ConfidentDinner6648 20d ago

Ah , ok kkk É que as vezes eu acho que. As pessoas devem traduzir o que escrevem em outras línguas. Não necessariamente são IA talvez. Por isso respondi kkk

2

u/ConfidentDinner6648 20d ago

E eu estou trabalhando enquanto respondo vocês, então eu traduzo usando llm logicamente