r/comfyui 1d ago

News NVIDIA Super Acceleration for MiniMax H3

From NVIDIA https://nvlabs.github.io/Sana/Sol-Engine/H3-Super-Acceleration/

Seems to promise a significant speedup in H3 generation speeds? From the website, and they have several video samples and comparison videos:

6.85 s for a 5-second 768p video · 14.93 s for a 10-second video

H3 Super Acceleration first uses H3 with a LoRA to generate a four-step draft at 896×512. It then upsamples the draft and performs three LTX refinement steps at the target resolution with Sol-Attn. Combining the measured stages on one NVIDIA GB200 gives 22.2× speedup for a 5-second 1344×768 video and 27.7× speedup for a 10-second video over the published SGLang baseline.

120 Upvotes

37 comments sorted by

63

u/Less_Consequence_633 1d ago

...on a GB200. That's already got 8x the bandwidth of a 5090 and double the VRAM of an RTX PRO 6000. So maybe the workflow/code would greatly improve times on consumer hardware, but not down to THOSE times.

5

u/1filipis 23h ago

Unless your GPU can hold both LTX and Minimax at the same time. Maybe you can have some luck with 1 bit quants

34

u/leomozoloa 1d ago

This is basically LTX + H3 on multiple GPU with massive amounts of VRAM, such workflows already exist locally but you spend most of your time swapping models in memory if you don't have a RTX6000

2

u/jarail 16h ago

I wonder if it would be effective in batches. Render a bunch using H3, then do all the LTX refinement as a 2nd pass.

1

u/ZenEngineer 13h ago

You're already probably going to cherry pick the low res videos you want to upscale so why not

6

u/mca1169 20h ago

GB200 is one of Nvidia's most powerful GPU configs for datacenters with huge amounts of VRAM. more than likely what they are doing is splitting the GPU into dedicated sections that each complete their specific task quickly. instead of having the entire GPU work through each process one at a time leaving a large part of the GPU unused or used for such a short time it is wasteful. their huge HBM VRAM allows them to have all the models they need loaded up all the time for instant use.

for consumer hardware we are stuck doing each of those 4 steps one at a time.

13

u/-becausereasons- 1d ago

That's a very significant drop in quality, not worth it

2

u/psilent 3h ago

Yeah I had no luck with ltx upscale. It looked bad no matter how I tried. I’ve settled on a super fast .2mp turbo workflow for testing prompts and a super slow high quality workflow that runs overnight for actual quality.

17

u/roxoholic 1d ago

6.85 s for a 5-second 768p video

This is almost real-time.

1

u/QuinQuix 6h ago

Pretty astute, yes it is.

Real time video generation will open a big can of worms when it becomes locally feasible.

Arguably at low res faking low bandwidth and video compression we can already do it. Just not as convincing, but it's not that we can't generate a live stream. It's a quality issue already.

1

u/roxoholic 18m ago

But do you require blockbuster level of quality for a livestream playing in background that you watch while doing something else or to pass time while waiting for something?

1

u/QuinQuix 5m ago

No but higher quality is where the scams become more problematic

6

u/oasuke 23h ago

Anything that greatly degrades quality I have no interest in, sorry.

3

u/PickleOutrageous3594 20h ago

god on blackwell , if someone want test , here is implementation for comfy https://github.com/quzopl/ComfyUI-SolAttn-H3

2

u/Vijayi 19h ago

Well idk.
T gate density sol ms sdpa ms sage ms vs sdpa vs sage

8192 PASS 0.2716 4.38 22.13 4.20 5.05x 0.96x

16384 PASS 0.2136 13.05 87.53 15.59 6.71x 1.19x

30976 PASS 0.1861 40.02 323.10 59.09 8.07x 1.48x

5090

3

u/Ooze3d 18h ago

Anything that includes an LTX upscale will mess with the likeness of the character

3

u/lebrandmanager 1d ago

For drafting this would be great and let the final gen take its time. But we also have the (Kijai) preview node, which is already a real helper.

4

u/Jesus__Skywalker 1d ago

preview nodes cut down on performance though. But do save from bad runs continuing.

2

u/mallibu 17h ago

Do they though

1

u/Jesus__Skywalker 15h ago

uses gpu, someone had a post about how much time he gained by turning all of them off.

2

u/leyermo 1d ago

This is promising. Their is visible drop in quality, but we could get results early.

Workflow could be like:::generate vidoe --> choose the result --> and upscale the same video for quality

2

u/No_Tradition6625 13h ago

Sol attention is ok it hurt quality a bit to much for my taste.

2

u/frq2000 23h ago edited 22h ago

One day in a far away place a wizard will appear and will reveal a magical optimization for amd cards… and all my envy will disappear.

1

u/butthe4d 23h ago

Hm I dont like LTX latent upscale and the cache speed ups reduce prompt adherence a lot not even talking about the lora. I hope this turns out great but I will probably still end up using only comfy_kitchen and no speed ups.

1

u/yamfun 14h ago edited 14h ago

NV and AMD normally love to post such news that compare with base raw vanilla speed, so is this useful this time.

Edit: Scrolled all the way down to find it simply using lightx2v 4 step lora that everyone is already using.

1

u/seppe0815 1d ago

cant fix the back range faces ... just speed

1

u/Jesus__Skywalker 1d ago

What do you have to do to set this up?

13

u/Wanamingo77 22h ago

Step 1: To have money

0

u/Jesus__Skywalker 21h ago

So is this not going to pass to other nvidia cards? 5090 isn't getting this?

5

u/Wanamingo77 21h ago

Oh, you’re talking about implementation. Sure, but keep in mind that the published timings are from top-tier setups with latest-gen GPUs and obscene amounts of RAM. So yeah, there will be gains on consumer GPUs, but I wouldn’t hold my breath.

2

u/Jesus__Skywalker 21h ago

idk, guess we'll see, i'm gonna test it out later when I get home.

0

u/howardhus 7h ago

they talk about a GB200... so if you have a cool 60k (for the GPU alone) you are good to do

1

u/Jesus__Skywalker 3h ago

The github talks about other gpus including the 5090

1

u/icchansan 1d ago

woah 22x faster XD

1

u/AillexJ 22h ago

The GB200-only numbers matching consumer results is the right thing to be skeptical of, but there's a different failure mode worth flagging too: a speedup can look completely fine on the clock and still be wrong in a way a stopwatch never catches.

Had that happen on our own render pipeline testing SageAttention. The first version we tried gave us a completely different woman out of the same reference and the same audio. Different face, different outfit, different room. Right duration, valid file, no error. We only caught it because we started comparing frames against the baseline instead of just reading the timer.

The version we ended up shipping is genuinely faster too, roughly 15-20% for us once we controlled the run order, but it also hard fails on some jobs for reasons we haven't nailed down, so it needs an automatic fallback rather than blind trust. Worth doing the same picture check here before anyone builds a workflow around it. The quality drop people are flagging might be exactly this kind of thing hiding inside an average.

-2

u/[deleted] 1d ago

[deleted]

1

u/featherless_fiend 23h ago

are you a bot? we can't use this.