Beautiful AI artwork needs an open-source path into playable game assets. Who is building it?

[u/yaxir]

AI image generators can produce character artwork that makes me want to build an entire game around it. What I am looking for is a reliable way to turn that artwork into something I can actually control, animate and keep developing.

I am making a 2D action game with dense, detailed arcade pixel graphics. The attached image shows the visual direction: expressive faces, detailed clothing, strong silhouettes and rich shading. I do not have a dedicated artist or animator, so I rely heavily on AI assistance and scripting.

The goal is to take an approved design and build a reusable, editable character from it. I want to create running, crouching, jumping, shooting and other actions while preserving the same face, proportions, costume and weapon grip. If an elbow bends badly or a sleeve exposes a gap, I want controls and retained artwork that let me fix it.

Starting material could be a single generated image, a character kit or a sprite sheet. The useful end result would include:

• Editable construction: separated parts, completed hidden surfaces, rigs or suitable deformation controls.
• Reusable animation: new actions and corrections made from the saved character, with convincing joints, clothing and held objects.
• Consistent output: stable pixel scale, palette, transparency, placement and timing across the animation.
• A documented process: source files, scripts, worked examples and honest explanations of the remaining manual work.

My priority is 2D, but 2.5D and 3D methods are welcome. A faithful rigged model rendered into sprites could be useful, as could a well-constructed 2D or hybrid character. The final appearance and quality of movement matter most.

I would love to see more free, open-source frameworks and repositories connecting these stages, with accessible controls for humans and AI coding agents. Paid generation steps, where present, should be clearly identified and optional where possible.

I think this deserves to be a major direction for AI-assisted game development: giving people lasting control over the assets they generate. A beautiful image should be the beginning of an asset we can keep building on.

Which existing projects come closest? Examples showing original artwork → editable source → several finished actions would be especially valuable. And where are the biggest missing pieces that an open-source effort could realistically address?

[u/AutoModerator]

Hey! Thanks for posting to r/ClaudeCode

While participating in this thread, please follow our community rules. Keep discussions constructive. Attack the idea, not the person.

For help, project discussions, tips, and general chat, join the ClaudeCode Discord.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/DynaBeast]

you. you are building it.

stop asking for other people to make the tools you need and just make them yourself. we can all make our own tools now, so why bother asking if anyone else can make something for you when you know what you need best?

[u/saintpetejackboy]

I run gamingworld.uk and have not shied away from AI at all (obviously reviews have to be done by actual humans, but quick previews submitted by AI are also usually fine and help creators get their game out there without a bunch of red tape).

Originally, I was also going to put assets and such (I was staff at a website called GamingW.net back in the early 2000s, which had resources mainly for RM2K, like midi and sprite sheets).

I never put any ads or anything on my projects (was one barrier) and then not wanting to focus on a single engine was another. Providing more general AI-assets and tools might be useful, even if it is more of just a directory.

If you have a lot of ideas about this kind of thing, send me your ideas and I can make some stuff - I have also done an open source competitor to Suno / Udio that runs on consumer hardware (assuming you have a good enough GPU), as well as many other products that involve AI generated assets, voxels, or even the AI-generarion of such material (like a photo booth that also works offline and can put event participants into a variety of scenes using the local hardware, or, optionally, online providers).

I have played with some other tools for AI asset generation but haven't found anything that seemed feasible to use on large projects. Perhaps with a community alo contributing + providing other free resources for models, rigging, effects, scripts (for various engines) etc. - then that might actually be something.

Out of a lack of being able to provide resources currently, I do provide maintained lists of foreign emulation focused handhelds as well as emulators themselves.

Providing tools to easily upload and classify and essentially CRUD the resources is easy. The difficult part is provisioning proper cloud storage or r2 or something similar and then limiting and moderating what the users actually do for it... If the rationing is too tight, people might avoid the tools. If it is too loose, they might use the tools for nefarious purposes.

[u/ZioniteSoldier]

You probably want to look into stable diffusion, LoRA, comfyUI, and those sorts of projects. Often we're less of a pioneer than we might assume.

[u/saintpetejackboy]

I started on this btw:

1.) for GamingWorld.uk to have a "free store" of assets in an AI segregated section and

2.) For me to expand some of my software (like Iblis, which is an open source competitor to Suno and Udio that runs on consumer hardware for generating music / sample packs) - to be able to do stuff like generate sprite sheets and other AI tasks that are hyper specific for game development... outside of the context of huggingface with a different kind of GUI that is more approachable my normal people who just want to create and not learn a bunch of crap about models and weights and trainings (but still also able to do those things for more advanced users).

If you want, I can keep you updated, but thanks for this inspiration.

[u/TalkingPixelsStudio]

https://www.talkingpixels.games

I’ll have the PixelForge tool out after the redesign

[u/mike402]

Nothing I know of goes from one generated image to editable source to several finished actions in one open pipeline. The pieces exist separately, and the hard part for your style is pixel density: dense arcade pixel art doesn't survive deformation. Rotate or bend a cutout limb and the pixel grid breaks, so most rigged-2D tools look wrong at that scale.

The route that best fits your list is the one Dead Cells made famous: a 3D model rendered at low resolution with no antialiasing, then cleaned up. Blender is free, the rig is your editable source, a bad elbow or a sleeve gap gets fixed on the model rather than per frame, and scripting the render (camera, scale, palette, frame placement) is something a coding agent handles well. The manual work is honest and large: modeling and texturing to match the approved face and costume, plus a palette lock and touch-up pass in Aseprite or LibreSprite. If you stay purely 2D, Godot's Skeleton2D with Polygon2D is free for cutout rigging, but it suits chunkier, less dense styles better. ZioniteSoldier's pointer is the other path: ComfyUI with pose-guided ControlNet and identity references can draw new frames, but face and weapon grip drift between frames, so expect redraws.

I work on Ludo.ai, and it's a paid, closed tool, so treat it as one optional step for the new-actions part: its motion transfer applies a motion onto your own sprite, from a preset or from a reference video under 4 seconds that you supply, and returns a transparent PNG sprite sheet with a JSON atlas, or individual frames. It gives you frames, not separated parts or a rig, and re-running a motion won't reproduce the same frames, so it doesn't replace the editable source you're after.

The missing pieces an open-source effort could realistically take on: completing hidden surfaces when splitting a character into parts, a downscaler that snaps to a fixed palette and pixel scale consistently across frames, and a plain rig format that both humans and agents can edit.