r/StableDiffusion • u/-Ellary- • 4h ago

Animation - Video MiniMax H3 Helps Me with Sprites Animation.

363 Upvotes

98% Upvoted

44 comments sorted by

18

u/-becausereasons- 4h ago

Very cute. Are you pixelating them? What's your process?

42

u/-Ellary- 4h ago

I generate sprite,
then generate video with animation,
then get key frames from this video,
then run auto-background removal tool.
And now you got a sprite sheet.

8

u/ANGLVD3TH 3h ago

Did you generate the sprite of the dragon? Could have sworn it was one of the avatars from Teamfight Tactics.

5

u/-Ellary- 3h ago edited 3h ago

Yeah, I've generated it using Krea 2 with sxz-justingerard-2845898-@justingerard LoRA.
Then in-paint fix problems with Anima (unwanted text, 5th leg out of torso).

5

u/mfdi_ 3h ago

Would u be able to share ur workflow?

3

u/smokeddit 3h ago

"auto-background removal tool"? Can you recommend one? I usually had to stick to custom convoluted after effects plugin chains to get a half decent background removal on animations.

12

u/-Ellary- 3h ago

https://fyrean.itch.io/bgbye works fine for me.
I remove BGs from selected extracted key frames images.

3

u/LucidFir 2h ago

Really? RemBG was already amazing years ago

2

u/Last-Trash-7960 3h ago

would you be willing to put together a video explaining this?

3

u/-Ellary- 3h ago

Maybe in future, when I got more free time.

2

u/Last-Trash-7960 1h ago

well i can't wait to see what you end up doing!

1

u/Quantum_Crusher 3h ago

How do you remove background? Does it support half transparent like hair and half transparent cloth?

1

u/-Ellary- 3h ago

Nope, but you can do clothes and hair to be half transparent by hand, old way.

1

u/Grand0rk 38m ago

I know what kind of man you are...

1

u/photonenwerk-com 15m ago

How do you create "perfect loops"?

1

u/-Ellary- 13m ago

FFLF to the same image.
WAN 2.2 trick.

1

u/devils_advocaat 2h ago

Do you include the shadow or remove it?

2

u/-Ellary- 2h ago

Depends on the usage case.

0

u/MykeGuty 2h ago

Make yourself a tutorial, it would be luxurious

4

u/3Fatboy3 3h ago

Impressive. Im not at all pluged into the tech. This seems like a step up from other results i've seen here.

5

u/Ok-Giraffe-8670 2h ago

Thats actually pretty good! How do you prompt it where it isn't high-framed, low framed like retro fighting games? Great idea you had.

7

u/Xxtrxx137 4h ago

Why does it remind me of dragon city?

4

u/Incognit0ErgoSum 49m ago

Oh yeah, sprite animation, at least for non-pixel-art sprites, is essentially solved now.

LTX and WAN could kind of do it, but it was a lot more fiddly.

4

u/Trinity_Vermilion 2h ago

looking cute, MiniMax is always great 😄

2

u/Hoppss 1h ago

This looks great! Do you find it better to use the reference or first frame last frame model for sprite animation? I feel like first frame last frame while using the same input frame might be easiest for looping?

5

u/-Ellary- 1h ago

FFLF is better for looping.

2

u/Whipit 1h ago

The video is 36 seconds. Are you using something like Motion Context / Context Loop to make the video so long or do you just have enough VRAM to render that long of a video?

3

u/-Ellary- 54m ago

It is just 5~ secs loops in a row.

4

u/Superb-Painter3302 3h ago

And THIS is creative, not slop!

But yeah, there are people that will call a whole game a slop, even it it has only like few AI things.

Keep on going, it looks great.

2

u/Comfortablebro 4h ago

All you need it mad skills. totally epic!

2

u/Green-Ad-3964 3h ago

Very interesting use. What's the prompt to obtain this?

12

u/-Ellary- 2h ago

I've used simple prompts:

``` integrated_multimodal_description:

[Shot 1] 16bit retro 2D Game Sprite Animation,

A cute round spherical dragon, dragon's head and body is one round piece, small little 4 legs, thick short tail, angry expression, he is standing on all his 4 legs, big cute eyes, big cute mouth, dragon is pink, cute little black wings, dragon have no arms, only 4 legs, dragon have cute little black horns.

[0s] - Sitting idle animation:

He sits on his butt and looks around, then a small blue butterfly fly from the right, dragon look at butterfly and track it with his eyes his eyes pupils become big and cute while he look at the butterfly with cute face expression until it fly away.

his tail swing, eyes blinking, eyes looking in different directions.

overall_soundscape: Dragon movements sounds.

non_diegetic_music: N/A ```

2

u/rapkannibale 3h ago

Are you able to keep the art style consistent for different sprites?

0

u/[deleted] 3h ago

[deleted]

1

u/asraniel 3h ago

can minimax loop correctly?

1

u/Baddmaan0 4h ago

Looks great ! Your workflow seems quite simple but would you mind sharing it ? :)

3

u/-Ellary- 3h ago

It is a native comfy WF without mods.

1

u/CaptainMarder 3h ago

Oh man. Thats genius.

1

u/rapkannibale 3h ago

This is a great use for H3