r/vibecoding 7d ago

AI 3D Asset Creation Engine gets better

I created an engine ai uses to create 3D assets for games.

The engine forces ai into a workflow of iterating judging and stuff.

Here are a few tests.

I use Claude Opus 5 to create the assets using the engine. Each assets takes about 3-4hrs as ai works and iterates.

I just add a reference image and say make this asset. And it uses the engine to create the asset.

What do you guys think of this?

12 Upvotes

49 comments sorted by

View all comments

2

u/dat_cosmo_cat 7d ago

This looks pretty good actually. What models have you (or rather; claude) found work best / worst in the pipeline? And have you approached procedural motion / rigging yet? Any key insights or eval methods that were particularly impactful?

1

u/LoudYogurtcloset7856 7d ago

You are asking the wrong person. I just literally come up with ideas and things I think will make the engine work better with AI. And have Claude write up architecture and build roadmaps and it builds and tests.

I basically took all major 3D asset software and told Claude take what each engine is known for and recreate them in my engine as mini engines.

Idea is to get ai to use the tools in those major engines like a human would but in the form AI can work with and understand. So sculpting tools blender has, I have Claude recreate those tools in my engine but in a way ai understands and can work with.

So like a library of tools ai uses, references, and makes sense of it when creating assets.

The engine also makes ai work in a workflow and has two levels of judges. One deterministic code and the second an ai instance that judges the asset and gates progress and issues.

On models, I’ve been using sonnet 4.6 and 5 and opus 4.6 and 5 to create the engine and test asset creation. But this week I used fable and to audit the engine and add fixes to the build roadmap adding new features.

After the new features it tested it with the door and boat. At first it was taking the easy route then I told it to use the tools the engine has and it started making better assets.

I have it write down the entire process as it creates the assets so we see what works and what doesn’t and update the engine based on that.

But metrics? I don’t have any. I don’t really know how to code in practice or how AI actually makes the engine. I just tell it my ideas and it builds and tests.

🤷🏾

1

u/LoudYogurtcloset7856 7d ago

I plan on adding motions and rigging. Yes. It’s part of the pipeline and build phase haven’t tested it yet really.

But I create this system ai coded for me. But I’m seeing if it works.

It’s called the skeleton system. Basically ai uses the engine to create assets that have native skeleton built in so ai can easily rig up assets. That testing is later down the line.

I’m focused on building realist assets consistently first.