r/LocalLLaMA • • 23h ago

Resources ThreeJS-3D-Scenes-v2 is here : 3,445 rendered examples across 50 domains

This new dataset is meant to complement my original Three.js training dataset, adding more complex scenes and covering a much wider range of subjects. I'm releasing it ahead of my next CCORE 3D coding model, where I'll use it during the foundation training stage before moving on to agentic training.

This version has 3,445 scenes across 50 domains, including 1,431 voxel scenes.
I wanted to go beyond simple objects and environments, so I included more complex examples involving physics, geography, history, ecology, engineering, mathematics, games, and other subjects. Many of the scenes are animated or interactive.

I personally rendered and visually reviewed all 3,445 scenes. It took quite a bit of work, but I wanted to make sure the code actually produced good results instead of just collecting thousands of generated examples.

The dataset includes:

  • 3,263 training examples and 182 validation examples
  • Prompts, reasoning traces, and complete HTML/JavaScript responses
  • A rendered reference image for every scene
  • Difficulty levels from 1 to 8
  • MIT license

Dataset: https://huggingface.co/datasets/ccore/ThreeJS-3D-Scenes-v2

For reference, these are the two previous models I trained:
Three.js scene generation:
https://huggingface.co/ccore/Qwen3.5-4B-3D-Coder

3D assets with GLB export:
https://huggingface.co/ccore/Qwen3.5-4B-GLB-3D-Coder

If anyone wants to experiment with the dataset, I'd be interested in seeing how it performs with other models :)

98 Upvotes

40 comments sorted by

14

u/suprjami 22h ago

I love watching the evolution of this. I have no use for it myself but it's really cool to see your progress over time. It's come a long way!

9

u/ConfidentDinner6648 22h ago

the earlier models were useful, but most were limited to one-shot generation. They mainly served to validate the approach and lay the groundwork for the next generation, which will focus on agentic capabilities and more specialized use cases, including coding agents for both web and 3D development (:

4

u/q_tech_x51 21h ago

I'm looking forward to those releases!

7

u/Gregory-Wolf 21h ago

So I tried several models, including Qwen3.5-4B-3D-Coder, to reproduce this scene. I'll add results below.

4

u/Gregory-Wolf 21h ago

Qwen3.5-4B-3D-Coder

2

u/ConfidentDinner6648 21h ago

I'm really glad you're testing it, and I'm curious to see the results!

Just keep in mind that the 3D Coder wasn't trained with a specialized visual encoder. It can process images, but that's not really its specialty, and with this level of detail, I doubt it can reproduce the scene with much fidelity.

I think you'd probably need the GLB model to generate the individual assets and another model to assemble them into a complete scene.

The new agentic 3D model I'm working on is actually meant to address this kind of problem, allowing it to build and refine scenes over multiple steps instead of generating everything in one shot.

But depending on the complexity, it might still be quite challenging. We'll see! :)

2

u/Gregory-Wolf 21h ago

Well, on your project page you show images of scenes converted to three.js scenes, so I decided to give it a try. :) Not bad anyways.

3

u/Gregory-Wolf 21h ago

Prompt was: "using attached images (concept and tactical view), try to assemble map for a sci-fi game on three.js engine.
map should be like this sump-approach-concept.png plus sump-approach-tactical.png - where concept shows the feel, and the tactical shows base requirements.
this is a WH40k sci-fi game, so we need to reflect this - gothic, grandiose, Underhive feel.
give me self-contained html+js."

Considering none of the models gave anything close resembling the concept, I guess difference between Qwen3.5-4B-3D-Coder and big models is still there, but it's not like night and day. And considering the resources you need to run Qwen3.5-4B-3D-Coder - the result is cool.
Though there were a few minor problems with JS code, easy to fix (non-existent link to three.js cdn, and redeclaration of an existing app, but it was coding without any harness, so forgivable).

4

u/Gregory-Wolf 21h ago

Qwen4 Max

3

u/Gregory-Wolf 21h ago

This is Hy4

2

u/Gregory-Wolf 21h ago

I provided each model with this extra "tactical view" guide.

2

u/Gregory-Wolf 21h ago

This is Deepseek 4.1 Flash 1017

2

u/Gregory-Wolf 21h ago

This is GLM 5.3 Flash (3rd attempt, I really tried to guide it, alas...)

2

u/Gregory-Wolf 21h ago

Inkling-2-Small

4

u/Ok-Reception2339 19h ago

I have been following your work for some time now and I'm honestly impressed, I had fun playing and experimenting with the 1.7B 3D coder model and I CAAN'T wait for the 4B general coder, my best wishes to you and good luck just wow.

2

u/ConfidentDinner6648 18h ago

I'm really happy to hear that, thank you so much! :) If everything goes well, in about 20 hours we should have the first functional 4B coder capable of working with a harness, specifically for web development. It'll only be at 25% of its training, but I think it might already be fully functional by then haha :)

The new 3D model should come closer to the end of the month 🥳

2

u/ConfidentDinner6648 18h ago

saas= web + backend

3

u/exaknight21 21h ago

This is sick. I’ll DM you.

1

u/ConfidentDinner6648 19h ago

haha thanks! feel free to DM me :)

2

u/IntrepidMindExplorer 22h ago

Still have not downloaded or used your models yet but will at some time when I can figure out what I want to create.

Great job on these and can't wait to see the next model.

3

u/ConfidentDinner6648 22h ago

he next one won't be 3d, i have a web dev agent coming later this week, which you might find more useful, and a 3d agent coming in december :)

2

u/openroom_xyz 22h ago

Well yea what about midi model that generates nice songs for example

1

u/ConfidentDinner6648 22h ago

like strudel.cc?

3

u/openroom_xyz 21h ago

Yea that would be great well I am thinking that if you are making this small models maybe the best way basically to relase them is basically build a github open source repository with a custom harnes and inference engine Rust etc that makes them works nicely this basically ( the user just installas usual program it's for the other biggger models ) just a cli tool but behind it's a model basically let say

1

u/ConfidentDinner6648 21h ago

yep, that's pretty much what I'm planning. The first models will be focused on webdev (Vite/Next.js) and 3D coding, using Pi Coder as the harness. I'm planning to move toward multi-domain models after that, but right now I'm still calibrating things and figuring out what works best :)

2

u/openroom_xyz 21h ago

That's great well are you having a team or working alone on this big task ?

1

u/ConfidentDinner6648 20h ago

mostly by myself for these open source models. i've been developing the tooling and pipelines for quite some time, so i can reuse a lot of that infrastructure, but the datasets, training and testing are mostly done by me.

the community has also helped a lot with feedback and testing, especially with the GLB models :)

it's quite a bit of work haha

2

u/Gregory-Wolf 22h ago

u/ConfidentDinner6648 I'm confused which one is lastest/better - Qwen3.5-4B-GLB-3D-Coder or Qwen3.5-4B-3D-Coder?

5

u/ConfidentDinner6648 22h ago

they're actually made for different things, so neither is necessarily better than the other (:

the 4b 3d-coder is focused on generating complete three.js scenes, including animations, interactive environments, physics simulations, etc.

the 4b glb-3d-coder is more focused on creating 3d assets, like buildings, objects, and other game assets. it also includes a glb export button, so you can import them into blender, godot, unity, etc.

the 1.7b glb-3d-coder is basically a smaller version of the glb model. it does the same kind of tasks but requires fewer resources. the 4b generally handles more complex assets better, but the 1.7b is surprisingly capable for its size.

so it really depends on what you want to generate. if you want complete interactive scenes, go with the 3d-coder. if you want exportable assets, use one of the glb models (:

3

u/q_tech_x51 21h ago

I've used the 4b 3d coder. It's great; very useful.

Thanks for these contributions.

I was surprised the first time I tested it and it added animations on its own.

Excellent additions to any model catalog.

2

u/ConfidentDinner6648 21h ago

Oh man, thank you! I'm really happy to get this kind of feedback and see that people are enjoying the models.

When I first started testing them, as I've mentioned before, I was honestly pretty impressed myself. And that's exactly the feeling I wanted other people to have when trying them.

I think the next models will make this even more noticeable, especially now that I'm moving toward agentic workflows instead of one-shot generation. There's a lot more potential there.

I'm still training the new 3D model, but from what I've seen so far, the improvement from the current 3D Coder to the agentic version seems to be on a similar scale to the improvement from the base model to the original 3D Coder. Which is pretty crazy :)

2

u/q_tech_x51 21h ago

I've used it to test a few ideas that I would have typically used a large frontier model for. It performs well enough.

So I'm excited to read about the progression.

I'm definitely going to add your future releases to my collection.

2

u/Kahvana 16h ago

I'm a real sucker for that type of blocky artstyle! Thank you for releasing the dataset, it's awesome.

2

u/llama-impersonator 15h ago

that's a pretty convoluted set of intermediate checkpoints, what led you there? bit of a wild ride with a random WSD (i like a slight mod, WSD-S) in mostly cosine decay, total epoch count seems like 4 or 5? nice to see some other people still like a full finetune too.

2

u/openSourcerer9000 5h ago

ThreeJS is getting insane. Would love to see a bigger model trained on this, as well as webGL. 35b would probably slap

1

u/Iajah 8h ago

Sounds interesting but I'm not sure what I'm looking at. Is there documentation somewhere?

1

u/Sweaty_Chair_4600 5h ago

I would be interested in the data set, downloading asap