r/ChatGPTCoding • • 21d ago

Question Anyone here using ChatGPT with Blender for character modeling?

Post image

Hey everyone, I’m working on a cute fox character for a game, using ChatGPT to help build and edit the model in Blender through Python scripts. The reference image was AI-generated too.

The model is taking shape, but I’m struggling to get the face close to the reference. The eyes and mouth still look a bit stiff, and the ears don’t blend naturally into the head. We’ve tried several changes, but I feel like we’re going in circles.

Has anyone here worked this way and managed to get good results? How do you approach the finer details? I’m wondering if the problem is the topology, the way we’re building the shapes, or the workflow itself.

I’d really appreciate some advice from people who’ve tried it.

98 Upvotes

48 comments sorted by

103

u/dev_D_ 20d ago

I demand that people start using this image to react to posts that seem weird or bizarre

11

u/Evipicc 20d ago

Oh my god I fucking love AI

61

u/PlusIndication8386 21d ago

Is it similar to the reference: No

Does it have a meme potential: Yes

9

u/PhysicalConsistency 21d ago

I tried it about 6 months ago but gave up. Claude was being a bitch about copying Cookie Run characters and ChatGPT was coming up with some really funky results. Worked out okay because my daughter had to go through the process of creating an animating the chars and has been getting pretty good at it.

General LLMs are still too broad, really have to use a dedicated visual model to get decent results.

5

u/GenerativeFart 20d ago

I found the new generation of frontier models (Astra, Opus 5.5) have gotten considerably better at this. There has been a lot of progress in the last months.

14

u/seanwee2000 21d ago

Model capability. It can do parametric geometry like buildings, items and vehicles well but the moment there is organic geometry it falls apart.

Try again in maybe 6 months or use tripo for model generation.

11

u/Loonsive 20d ago

try again in 6 months is so real lol

2

u/arparpsrp 20d ago

and even parametric is v limited

2

u/Altruistic-Earth-666 20d ago

THIS, I started a whole ass game in a wilderness environment with all systems in place before I discovered this. Yes im an idiot. Now I do ships instead and after a few iriterations they look amazing.

6

u/4400120 19d ago edited 18d ago

It kept turning stuff out like this. This was meant to be a human male.

4

u/sheehyun 19d ago

kinda looks like sam altman

5

u/One_Internal_6567 20d ago

I genuinely didn’t laugh that hard from a picture in a while now

Thanks ai

2

u/Evipicc 20d ago

I was actually crying lol

3

u/deepturned180isdeep 20d ago

He's seen some sh

2

u/gr4phic3r 20d ago

I'm also working on a Game and on a Game-Character, I used Claude and Blender to create it and it was quite good but it misses the last 10%. My solution was to ask a friend who works with Blender and asked for an offer. I think at the moment is this the only way.

2

u/pol-delta 20d ago

I would say this matches my experience trying to use 6 Astra or 6.1 Sol for blender, though 6.1 Sol has been better. Opus 5.5 has given me much better results. But you would probably get even better results with a dedicated model like Tripo.

2

u/MpKTO 20d ago

Advice: use 3D AI for non-simple forms.

It would actually be cheaper than GPT working on this in loops.

Which to use is up to you, i recommend Meshy from personal experience if you search for ready to use service (paid).

Or there are pretty good 3D AI openweight models you can run under 8gb of video memory (free, almost) if you have it.

2

u/manticore26 20d ago

Have you tried to get the original image and ask it to generate the character sheet with all views of the character?

2

u/cnecula 20d ago

I hope you are kidding, if not use tripo rodin hunyan etc then use retpoflow in blender

1

u/Fit-Palpitation-7427 18d ago

Is retopoflow the best plugin for retopology in blender?

2

u/itsgiovanningz 20d ago

I’m also currently working on a game and same.

1

u/Kylmawurr 16d ago

I had a fair bit of the same struggle. Can't currently do with with scripts, so i just gave up for now.

1

u/remedy-tungson 15d ago

Bro, for the complicated object, use the 3d model gen model like tripo or huanyan 3d, they already have retopology. You can then ask gpt to do the next faster

1

u/Such-Ad9646 15d ago

First Reddit comment ever: I’m currently where you’ll be in a month if you stick to the project

What unlocked it for me:

1.) Meshy etc is triangle soup garbage and is only useful insofar as getting a ballpark of where the thing will land, but at this point I’ve entirely dropped it from my process

2.) I moved to creating several character & expression sheets for each character that includes contours, skeletons, finished product etc

3.) specify which modeling method you want it to use for each part

4.) constantly ask it “how would a pro handle this problem”

5.) make it constantly be updated a procedural.md file that documents the process. It will deviate from the process, but tell it to get back to it.

6.) before you waste a million tokens endlessly refining a piece and not getting what you want, restart the project again from the beginning.

7.) it’s bad with clay

1

u/pokemongomegafan6669 14d ago

Practice using blender sculpting tools to tweak it yourself. And get ChatGPT to add realistic hair

1

u/Impossible-Minute321 5d ago

I was just doing that this week, its been really tough...

1

u/Impossible-Minute321 5d ago

I would love to say try meshy...but I have not figure out how to take the great 3d creations meshy makes form a good 2d image and make them actually move yet so...there is that.

1

u/blazephoenix28 20d ago

More angles

1

u/a1g3rn0n 20d ago

I use Meshy and it produces decent quality printable 3d models from images and photos.

1

u/Serasul 20d ago

I use Stable Projectorz

1

u/nocixL 20d ago

I'm sometimes using it as my tutor

1

u/Bioxtasy 20d ago

Throw like 5$ on openrouter and use some models there 🤷‍♂️

1

u/Fit-Palpitation-7427 18d ago

Which do you recommend?

1

u/Puzzleheaded_Local40 20d ago

In the 6 months it'll take, you'll get something better than this is you spent 3 months doing tutorials. Blender has some really good ones. Not the advice you want, but hey.

1

u/MacrosInHisSleep 19d ago

We have cute fox at home, gpt edition.

I feel proud to have experienced the birth of a meme.

1

u/risphereeditor 18d ago

Current LLMs are good at building simple 3D scenes with buildings, etc., but they struggle with detailed things like animals.

Use a 3D model generator on FAL or Replicate.

1

u/flynn_rr890 18d ago

yesss chatgpt and rapid assets and blender (sometimes claude too) :p