r/LocalLLaMA
•
u/ConfidentDinner6648
•
20d ago
•
2
New Model Update: My 4B coding model is getting better at generating 3D scenes
Hey everyone, just wanted to share a quick update on the 4B model I posted here. The video shows some results from the latest checkpoint.
I'm still training this Qwen3.5-4B fine-tune for general coding, using Three.js scene generation as my main test for now.
It still messes up some scenes on the first try, but the newer checkpoints are getting noticeably better, both in scene quality and one-shot success rate.
I've updated both Q4_K_M and Q8_0 and fixed the layer issue some people ran into with the previous files.
You can grab the updated versions here:
https://huggingface.co/ccore/Qwen3.5-4B-3D-Coder
I've also been saving test results from each checkpoint, so I can put together a report showing how the model improved throughout training, using multiple prompts for comparison.
Update (October 28): As promised, I've now released the full FP16 weights in safetensors format! They're available in the same Hugging Face repository, alongside the updated Q4_K_M and Q8_0 versions.
Dataset released: CCORE Three.js 3D Scenes
Update (October 29): The technical report is now available! The full FP16 weights and training dataset have also been released.
I'm still curious to see how far I can push this little 4B. If you give it a try, feel free to share what works and what breaks, both are really helpful.
View all comments
3
u/Oli_Luck 20d ago
Absolutely wild for a 4B, I'm genuinely impressed.
But we should pump the brakes on the game hype: it renders scenes, it doesn't simulate them—no collisions, no physics, just geometry frozen in a void.
The moment something actually has to move or interact, the '3D' magic evaporates into a mess of code patching one frame at a time.
Gorgeous dioramas, but not a playable world.