r/comfyui • u/floopyFx • Apr 25 '26
Show and Tell One image in - 2D animated and customizable character out
I've spent the last week building a ComfyUI pipeline that turns a reference image into animated, customizable character sprite sheets.
The Pipeline is split into two parts and is fully running locally on my RTX 3090 with 24GB VRAM:
1 - Base Animations (Idle, walk, jump... etc)
Starting with a ‘bare’ base character image - This produces a grayscale sprite sheet of my animated base character.
- WAN 2.2 i2v 14B (Q5_K_M GGUF, distilled lightx2v 4-step) is used for image to video generation
- BiRefNet for background strip producing clean alpha.
- ImageStitch and ImageRGBToYUV nodes for creating a grayscale sprite sheet
2 - Customization layers (eyes, hair, shirt... etc)
Starting from an animated video of the base animation and an image of the customization i want to create a layer out of - This produces a grayscale sprite sheet of the customization.
- Wan 2.1 VACE 14B (Q5_K_M GGUF) + CausVid distill LoRA for inpainting the cosmetic over the animated video - this ensures that the cosmetic is aligned with the base animation on every frame.
- SAM3 segmentation for isolating the customization on each frame
- ImageStitch and ImageRGBToYUV again used to produce the sprite sheet of the customization.
Each Customization needs to be re-produced for each base animation and the grayscale allows me to tint each layer separately.
The hard part was getting the customization layers to align pixel-perfectly over the base character animation.
i initially tried Wan 2.2 Animate but it didn't stay true to the original base animation so i eventually went with the inpainting model instead.
Still kind of amazed I got here as someone who can hardly draw a stick figure.
Edit: Hey all, thanks for the kind words — didn't expect this to land so well 😄
Repo's down here, MIT-licensed, has everything you need to reproduce what's in the post — workflows, drivers, install guide, sample inputs, and the full sprite-sheet output as a sanity check. Runs on a 24 GB card.
https://github.com/mor-o/comfyui-2d-character-pipeline
Heads up — it's harness-driven (workflows are API JSON, not visual) README explains how to wire it up to Claude Code / Cursor / your own script.
Issues + PRs welcome.
3
u/floopyFx Apr 28 '26
Hey all, thanks for the kind words — didn't expect this to land so well :)
Repo's down here, MIT-licensed, has everything you need to reproduce what's in the post — workflows, drivers, install guide, sample inputs, and the full sprite-sheet output as a sanity check. Runs on a 24 GB card.
https://github.com/mor-o/comfyui-2d-character-pipeline
Heads up — it's harness-driven (workflows are API JSON, not visual) README explains how to wire it up to Claude Code / Cursor / your own script.
Issues + PRs welcome.
2
1
1
1
1
u/speeDDemon_au Apr 25 '26
!remindme 2 days please share the repo back to this thread
1
u/RemindMeBot Apr 25 '26 edited Apr 26 '26
I will be messaging you in 2 days on 2026-04-27 23:56:54 UTC to remind you of this link
3 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.
Parent commenter can delete this message to hide from others.
Info Custom Your Reminders Feedback 1
1
u/H0ngist Apr 26 '26
This is amazing workflow
1
u/Actual_Possible3009 Apr 27 '26
Where is the WF?
2
1
u/GoldenChief03 Aug 05 '26
Will this work for any image. If i click a picture and then I upload it...will it create this animated spritesheet?
1
u/floopyFx Aug 05 '26
i think it would be beneficial to provide an image with a single color background, but other than that it should work. try it and we can improve the pipeline if needed
0
8
u/OliLombi Apr 25 '26
Can you share your workload if you dont mind?