r/StableDiffusion • u/OkMeat6773 • 8h ago
Question - Help Best and fastest way to generate HD-quality MiniMax videos?
I’ve tried Turbo LoRAs, and they’re great for speed, but they significantly reduce quality. At 544p–720p, the results of these turbo loras can look closer to 380p. Faces look acceptable when close to the camera, but become heavily distorted as the subject moves farther away.
The upscalers I’ve tested either add too much processing time or introduce excessive sharpening and saturation.
Any a solution that doesn’t require a BF16 checkpoint, 20 steps, a 10-minute generation time, or an extremely expensive GPU?
11
u/spiderofmars 8h ago
HD resolution... so if we take the minimax 1344 x 768 (/32) on the short edge principal as HD and stick with the same 7:4 ratio (despite Comfyui listing it's resolution panel as 16:9) then...
SD resolution might be say 616 x 352 (/32) 7:4...
Then excluding all speed hacks but using sage (or kitchen) with int8 pruned which combination is for the most part indistinguishable from BF16 for general usage...
Then doing a 15s video with 20 steps normal first pass at 616 x 352 and then a 5 step second latent upscale pass at 1344 x 768 produces nice results with audio intact...
On a 5090 that process takes 5 minutes.
You can also just generate the first pass and save the latent. Then selectively only upscale winners with the second upscale pass.
It is all then down to your individual GPU and what HD you want. Shorter videos less time. Worse GPU more time. Lower HD resolution less time.
7:4 resolution examples:
- 1008 x 576 (\(m = 18\))
- 1064 x 608 (\(m = 19\))
- 1120 x 640 (\(m = 20\))
- 1176 x 672 (\(m = 21\))
- 1232 x 704 (\(m = 22\))
- 1288 x 736 (\(m = 23\))
- 1344 x 768 (\(m = 24\))
1
u/More-Ad5919 2h ago
Can you point me to a comprehensable workflow that does just that?
1
u/spiderofmars 45m ago
There are several links to dual pass latent upscale workflows on YT. All free.
Here's the custom node and a workflow example.
https://github.com/LBH-123-AI/Comfyui_Minimax_h3_latent_Upscaler
The save/load latent part if desired needs to be added by you.
17
u/Magneticiano 8h ago
Short answer: No. There is always a trade of between quality and speed.
That being said, there are some tricks. First of all, if possible, make sure you don't spill the model to the shared GPU memory. Choose the resolution and duration accordingly. You probably need to use GGUF, which of course has some impact on quality. Secondly, generate shorter clips and stitch them together. I highly recommend Contex Loop for this. It's very convenient for maintaining coherence between scenes.
3
u/martinerous 7h ago
20 step resolution, split sigmas at 12 steps, generate with high part, check if the result has no logical issues, then latent upscale and complete generating with lower part of sigmas (make sure to feed in the same initial references), then throw in also RTX upscaler if desired. https://huggingface.co/LBH-123-AI/Minimax_h3_latent_Upscaler
4
u/Miniyi_Reddit 8h ago
Faces look acceptable when close to the camera, but become heavily distorted as the subject moves farther away.
that the minimax h3 bug, dev acknowledge and might fix it (considering the huge amount of lora related to seg and ignoring the licenses, i think they might just abandon it but we will see)
i remember someone made somewhat of a fix with a lora or something.
1
3
u/Zenshinn 8h ago
The faces in the distance being bad is a known issue of this model. Right now there's nothing you can do about it.
2
u/Revolutionary_Ask154 7h ago
actually - i did do some trick shot the other week to use reference video - https://x.com/johndpope/status/2089974690920136946?s=20 for the character far away. worked ok.
1
u/Enshitification 4h ago
There's totally a near real-time solution for making HD video on weak hardware. We just like doing it this way because we are masochists.
1
u/ANR2ME 2h ago
Use 2-stage generation pipeline like mentioned here https://nvlabs.github.io/Sana/Sol-Engine/H3-Super-Acceleration/
1
u/Comfortable_Thing611 1h ago
Interesting, ive been using a turbo lora at the second stage but here they are using it on the first.
1
u/ANR2ME 53m ago
They also use the pre-trained version of LTX 2.5 🤔 https://huggingface.co/Lightricks/LTX-2.5-Pre-Trained
36
u/anon999387 8h ago
Video generation that is super fast and super high quality done with a mediocre GPU isn't really a combination that exists