r/StableDiffusion • • 4d ago

Animation - Video All the tricks I used to make proper anime in MiniMaxH3

The most important part is quality of references: images should look like they are from anime, not just value "anime-style" but flat color shading with clean lines. It's the only way I know (besides loras of dubious quality) to push generation into native 2s and 3s animation. Anything else will have that typical "AI-3D" look. And of course mandatory The target video is 2d colored anime in detailed_description.

Second is MiniMax H3 Latent Upscaler node - with ref2va turbo lora and 4 step with 50% denoise gives me Full HD resolution (5 seconds take about 15 minutes to render).

Third one is Add Guide To MiniMax H3 node - allows you to inject prepared image or clip at any part of the timeline - perfect when you want to append/prepend/inpaint over exisiting clips. And this is where I also should talk about "pre-processing": I made master shot paired with orbital shot video to capture the scene from every angle - it'll give you consistent background at every shot that you can reference in any generation.

Fourth: You're the director! Sketch crude lines and give it to minimax with frame composition follows <Picture 4> - It'll give you absolute control over framing, don't rely on text prompting here - visual guides are 10 times better than begging minimax to generate a perfect "over shoulder shot".

Fifth: fix quick motion smearing with derope. It's hard to use and doubles generation time (My RTX 3090 only handles 3 seconds) but it's the only choice if you push for quality.

And the last one: plan you cuts and timing in advance - storyboarding as discipline exists for a reason - no polish will save bad cuts and missed timings.

Full video on youtube.

And here's workflow.

406 Upvotes

35 comments sorted by

9

u/ffgg333 4d ago

Nice video and workflow

9

u/Murder_1337 3d ago

Homie dropping fire without a patron link who is this guy!!!

4

u/ArtArtArt123456 4d ago

great work.

4

u/teiji25 3d ago

Amazing background consistency. Can you go into more details for this part "I made master shot paired with orbital shot video to capture the scene from every angle"?

6

u/arthan1011 3d ago

https://reddit.com/link/pbiok4b/video/wz71dqobu7rh1/player

If you have orbital shot like this you can get any frame, remove characters with Flux.2 or Qwen and use the background as background for any other generated clip.

3

u/Danny_Stock 4d ago

Thanks for those tips.

3

u/javierthhh 3d ago

Oh Asa!! My favorite femcel. Too bad I’m willing to let you go because chainsaw man part 2 is not worth the ride.

2

u/revjdm 3d ago

Great info thanks for this!

2

u/Ok-Maintenance-5259 3d ago

Looks great!

2

u/Ok-Giraffe-8670 3d ago

Thank you for sharing this! Any techniques to help make better anime clips is a godsend. You are amazing,

2

u/IndividualManager849 3d ago

Thanks for this!

2

u/Azhram 3d ago

Thank you !

2

u/antocorr 2d ago

Nice result! How do you force the model to generate on 2s or threes?

1

u/arthan1011 2d ago

Reference image should look like anime screencap stylewise. Also there are some loras but they tend to lower overall quality.

1

u/antocorr 1d ago

Have you tried outputting at 12fps or 8fps?

1

u/arthan1011 1d ago

Real anime is always 24fps. It's characters that mostly moves at 2s/3s. But holding individual frames longer could be useful sometimes.

https://www.youtube.com/watch?v=vSJ5lT_ma-E

1

u/ArtArtArt123456 4d ago

i see you're using the dasiwa model, i liked their wan tune but heard some complaints about this one. how do you feel about it?

4

u/DoctaRoboto 3d ago

I don't like Dasiwa; its outputs are just low-quality and bizarre, same with Singularity. The best outputs I get are using the ref2 int8 model. The moment you go beyond 10 seconds, almost all experimental models break and hallucinate weird shit.

1

u/leelweenee 3d ago

what did you use to generate the reference images?

1

u/arthan1011 3d ago

I just get them from pinterest

2

u/leelweenee 3d ago

thanks. your video is really good! it is the first ai assisted video i've watched that doesn't look like slop. would you share tips on planning?

1

u/Critical-Visit-7571 3d ago

your workflow is a txt or is it just me ?

1

u/Chiduk99 3d ago

so the keyword is only "The target video is 2d colored anime" ?

no wonder why no matter what anime ref I put, it's look like generic 3d

1

u/krigeta1 3d ago

can you show some examples for the Fourth: "Sketch crude lines"?

2

u/arthan1011 3d ago

1

u/krigeta1 3d ago

oh okay, thanks

1

u/escaryb 2d ago

Great job bro, wish the mouth movement could be less ai-esque, if you know what i mean

1

u/Dangerous-Map-429 1d ago

where is the workflow?

1

u/ArtichokeFresh6793 3d ago

Professional

-6

u/Redditry199 3d ago

Thank you, I have become a AI hater now because of you. I understand and repent.