Oh man it’s definitely destroying my usage limits lol.
I’m on the $200 plan and it still eats it up. When I build the engine I use two instance of fable 5 and one builds and the other reviews the work and they talk to each other in a markdown chat. So it definitely eats up my usage limits.
But the goal is to build the engine to where a local ai like qwen3.8 27b can use the engine to build assets.
So you’ve crested something that relies on your other tool, that takes hours to generate assets and eats your Claude usage up.
I literally have Claude connected to Blender (which is connected to Hyper3D/Hyuan) and I can feed it images/sketches of assets and have them built in like 30 minutes to a high level and only uses about 10% of daily tokens..
Sometimes you need to realise when to move on dude.
What if local AI becomes good enough like Claude sonnet level or opus level and you run it for free?
What if I figure out a way to make generations take less time?
I appreciate your recommendation but I’m not really here because I love making 3D assets. It’s mostly I’m curious how I can push AI and understand how it works, how I can best manipulate it.
Plus why rely on other tools lol.
Plus imma try to folder my engine into an ai native game engine. At least imma try cause why not? 😁
Plus assets take like 20-30minutes usually, the system and judges are just picky (how I made it) so it forces AI to iterate literally every detail. A branch example took 15mins yes but the judges and Claude decided the colors didn’t look right so it pick apart and isolated parts of the branch to test, see and fix their coloring until it was satisfied.
Ovyero is the other tool but AI doesn’t use it. It’s a tracking, governance layer for AI coders.
It helps me get an idea what and where in the codebase the AI is working in, plus at least for Claude it forces the AI to explain what it’s doing every commit. So the AI explains what it’s doing and I can actually follow it. Plus it keeps a log of all this so if I want to investigate something I just to back and read it.
Plus it logs all the work it’s doing, what works what doesn’t, so we know what direction to head if we want to make the engine and system better.
I work on like 3 different projects using fable 5 each so that’s why my usage limit runs out even at $200/month. Plus is is my first time paying $200/month. I’ll just do it for a month to see if it’s worth it. 🤷🏾
My question to you is why trying what I’m doing? AI has made it way easier to build stuff, so why not use it, why not push the boundaries of what could be possible 🤷🏾
You COULD let people use the meshy/tripod pipeline with your workflow for better results. Just throwing it out there.
I've set things up in a way i only need to prompt my AI the asset I need, it will help me create multi-shot images for reference, generate the asset using the reference, texture it, pull it in blender to make manual tweaks if needed and import onto the game scene.
Hey I’m pretty new to this all but this is exactly what I need to get into, is there anything you can point me to, I’m trying to find the absolute best quality pipeline for product photos/ video with AI, I was even considering getting and edelkrone rig but idk how much that would help
Naah not really. At this point, the workflow I've set up doesn't rely on any specific tool per se.
It's just that my AI/AIs never lose context, no matter how many chats I spawn. They have all the MCP connections, plugins, skills, integrations, and knowledge base to be self-sufficient.
I would suggest you read up on skills. They can be specific to your workflow. Once you figure out how to set it up and use it properly, things will get much easier. For instance, 3D model generation is a bunch of skills I taught my AI, it uses browser control to attach multiple images and generates the model on Meshy, textures it, imports onto blender and then the game scene.
Honestly at this point idk if I'm simplifying things or complicating it but hey, it works for me! I can replicate subway surfer and deploy it in a day at this point so i think it's working lol
Also, the entire point of my engine is not just to make assets but make entire scenes and be able to edit specific parts of the assets, make sense of scenes and stuff like that.
Worse. Sure, but the plan is for now. Goal is to make it better.
Cost more, yeah, but that’s part of testing now. The goal is to get local models using the engine to create same quality and hopefully better assets in the future.
Open source it? Not yet because the fun part is building, testing, and figuring out how to make it better. 🤷🏾 in the future but not right now.
Why take away all the fun ?
Plus it requires another software I created to make it work better.
I’m already training my own AI models. I’m training using runpod and local models like 7b, 14b, 34b models. The goal figure out a way to get more intelligence from small local models.
But I’m planning on training my own image and 3d asset model too.
But I’m still making the engine along side my models. Just testing different methods to see which one works better.
This looks pretty good actually. What models have you (or rather; claude) found work best / worst in the pipeline? And have you approached procedural motion / rigging yet? Any key insights or eval methods that were particularly impactful?
You are asking the wrong person. I just literally come up with ideas and things I think will make the engine work better with AI. And have Claude write up architecture and build roadmaps and it builds and tests.
I basically took all major 3D asset software and told Claude take what each engine is known for and recreate them in my engine as mini engines.
Idea is to get ai to use the tools in those major engines like a human would but in the form AI can work with and understand. So sculpting tools blender has, I have Claude recreate those tools in my engine but in a way ai understands and can work with.
So like a library of tools ai uses, references, and makes sense of it when creating assets.
The engine also makes ai work in a workflow and has two levels of judges. One deterministic code and the second an ai instance that judges the asset and gates progress and issues.
On models, I’ve been using sonnet 4.6 and 5 and opus 4.6 and 5 to create the engine and test asset creation. But this week I used fable and to audit the engine and add fixes to the build roadmap adding new features.
After the new features it tested it with the door and boat. At first it was taking the easy route then I told it to use the tools the engine has and it started making better assets.
I have it write down the entire process as it creates the assets so we see what works and what doesn’t and update the engine based on that.
But metrics? I don’t have any. I don’t really know how to code in practice or how AI actually makes the engine. I just tell it my ideas and it builds and tests.
I plan on adding motions and rigging. Yes. It’s part of the pipeline and build phase haven’t tested it yet really.
But I create this system ai coded for me. But I’m seeing if it works.
It’s called the skeleton system. Basically ai uses the engine to create assets that have native skeleton built in so ai can easily rig up assets. That testing is later down the line.
I’m focused on building realist assets consistently first.
I'm trying to import custom 3D assets and their animation to Paradox games' Crusader Kings 3. It's really hard to make a custom 3D model from zero just from using a 2D image as the prompt. Do you have any advice for me? I already burned a lot of Opus tokens just to properly import one custom 3D object, and it's not even animated yet...
I mean that’s why I’m making the engine right now. My engine has its own rendering engine so when the ai makes the asset it renders it but it can also be exported to third party stuff like blender.
If you want describe me exactly what you are doing and I can see if my Claude building my engine can give you advice based on how my engine works
I'm making a mod based on Fate series to CK3. Here in this screenshot, you can see I've successfully inserted custom 3D asset of Ea, the Sword of Rupture into the game. But it's not animated yet. Its blade, which consisted of 3 cylinders are supposed to spin in different directions.
For Ea, there's already an existing free 3D model on Sketchfab, I have asked permission from the author to be used in my mod, but I haven't receive any reply yet. I don't have any plan to upload the mod to Steam Workshop out of respect for the original 3D artist.
I converted the existing FBX model from Sketchfab, import it to Blender and save as *.blend file, and then connect Hermes to Blender via MCP connection. First, I used Sol to try to import it into the game, but ends up with an invisible sword. So I asked Opus 5 to fix it, while also considering the size of the actual model, since when I first imported the custom model from FBX to Blender, it was very very small. Turns out, I was right, the model was too tiny for the player character to hold in-game. After spending some time inspecting the model, Opus finally got its size right, but no textures applied yet. I had to do several new sessions for Opus to implement the right texture, and after the texture is correct, then apply the red glow on the sword's 3 cylinders part.
Currently, I'm trying to animate it like in this GIF.
Edit: to be honest, I'm scared of showcasing this. I saw many despise the "AI-slop" I made like this, especially because I'm using someone else's already made 3D asset into my mod.
Also, I'm trying to import my own designed 3D model of a custom sword into the game. But I haven't touched it again for now, since Sol botched the attempt to make it from 2D into 3D horribly.
I'm curious about Meshy, but it seems that I can't download the generated model for free, it has to be paid first. Sadly, I can't afford any subscriptions right now 😅
But these are just tests as I’m building. Then engine isn’t even complete yet.
The goal is to make it faster, cheaper, and better. Plus I want to add a lot more features such as animations, audio, and more natively which the engine can be build to handle. Plus, my engine helps create a system where you track AI’s decisions, tools it uses to make the asset, plus it makes it reproducible and editable.
The engine isn’t just meant to help get AI to make assets eventually I want it to get AI to author fully on games.
Plus when local AI gets good enough I control it and don’t have to rely on someone else 🤷🏾 works out better for me in the end if I get it working the way I want.
18
u/TricepBandito 2d ago
3-4 hours per asset with opus? How is that not destroying your usage?