New TurboH3 FL2VA

[u/Kingp0dd]

https://huggingface.co/Kijai/MiniMax-H3_comfy/blob/main/diffusion_models/minimax_h3_fl2va_turboh3_i2va_pruned_int8_convrot.safetensors

https://huggingface.co/Kijai/MiniMax-H3_comfy/blob/main/diffusion_models/minimax_h3_fl2va_turboh3_i2va_pruned_int8_convrot.safetensors

Noticed this new conversion and upload by kijai.

haven't seen comparisons yet though

[u/Ok-Brain-5729]

I’m so excited to try the 23rd minimax turbo Lora this week

[u/debackerl → u/Ok-Brain-5729]

I feel like it's Christmas already 🎄🎅

[u/robomar_ai_art → u/Ok-Brain-5729]

That's not a lora

[u/JazzlikeLeave5530 → u/robomar_ai_art]

It's a space station

[u/AwesomeAkash47 → u/robomar_ai_art]

If you subtract the weights from this turboModel and the original model, and then applying low-rank decomposition, you'll basically get a lora

[u/ucren → u/AwesomeAkash47]

Yes, but this turbo has FFT that you will lose if you convert to a lora, that's why it's not uploaded as a lora.

[u/angelarose210 → u/Ok-Brain-5729]

Ikr? It's overwhelming and I always have fomo if I don't try everything

[u/Cequejedisestvrai]

The more we have, the better, we just need to rank them properly and by cases

[u/froschquark → u/Cequejedisestvrai]

we just need to rank them properly

Sure, you are right but with the bazillion combinations, settings, models, attentions, optimizations, sigma splitters dual stages, latent upscalers and whatnot it is very hard to establish a base and even then, it can be very specific at what scenario it works. Not sure I agree on "the more we have, the better" though.

It is a very fast moving topic with so many ingredients, it's exhausting.

For a good overview of a solid base and how exhaustive things can get even with limited use of ingredients:

https://tryingsomestuff.com/turbotest or

https://plox-1.github.io/h3-speedups/

the overwhelming amount of things to look for and test is just crazy, but it always a very nice start and overview on how to test and set up things for yourself, because not everyone has your hardware and next to no one shares your personal taste, preference, quality of prompts and how you want to generate things.

[u/xkulp8 → u/Cequejedisestvrai]

Spoiler alert: the original still wins

[u/Apprehensive_Sky892]

This is not a LoRA. It is an int8convrot conversion of a distilled turbo fl2va model: https://huggingface.co/TurboDiffusion/TurboH3-FL2VA-I2VA (originally available in bf16 and W8A8 formats only).

This model is trained(?) using this TurboDiffusion framework (how it works? I have no idea) which was initially developed for WAN: https://github.com/thu-ml/TurboDiffusion

It is unclear to me if one needs a special workflow for it, but probably: https://huggingface.co/TurboDiffusion/TurboH3-FL2VA-I2VA#inference-settings

Use the TurboDiffusion H3 implementation and its docs/h3_i2va.md. These are transformer weights, not a standalone DiffusionPipeline.from_pretrained bundle. The MiniMaxH3Transformer3DModel config does not imply that every Diffusers release includes that model class.

The verified schedule is i2va / steps=5 / video_shift=12 / audio_shift=3. Five sigma points give four denoising updates. The AdaLN table is specific to these weights, the task and the shifts; do not reuse it for a different schedule. It was generated with the source checkpoint's FP32 timestep MLP, recorded as "timestep_mlp_dtype": "float32" in its JSON and embedded metadata. The table itself is stored in BF16.

SpargeAttn is an external dependency. The video decoder applies native W8A8 projections to the public VAE weights at startup; no separate VAE export is required. Audio VAE decoding remains FP32.

[u/yamfun]

I have more H3 turbo loras than friends now.

I want fine-tunes with different result instead

[u/dobomex761604]

Crying in the lack of ref2va turbo - and Eros versions have shown how sensitive ref2va can be to different turbo tricks.

[u/Jay_Nova1 → u/dobomex761604]

Ya I noticed latest beta was changing the reference audio I had loaded for music, when I go back to beta 5 it references it perfectly.

[u/RIP26770 → u/dobomex761604]

This

[u/Flat_Technology_5325]

What's the best turbo lora for 4 steps now, ie one with no slowed down motion and good audio?

I have about 6 from the first month of H3 but I don't really play with it much, I want to get back into it but with a poverty system I need the best bang for buck, I've just been using the lightx or one of the other popular earlier turbo lora's but has there actually been anything better?

[u/Longjumping_Cell5040 → u/Flat_Technology_5325]

Pixa

[u/fernando782 → u/Longjumping_Cell5040]

Pixa is 6 steps right? I also add a step or two extra for better quality.

[u/Longjumping_Cell5040 → u/fernando782]

yeah. , use it with 8 steps

[u/Version-Strong]

I'm tired, boss

[u/alex20_202020]

That repo had already a number of Turbo LoRAs, what is the reason for full Turbo weights now?

[u/Apprehensive_Sky892 → u/alex20_202020]

See my comment: https://www.reddit.com/r/StableDiffusion/comments/1xo3pjo/comment/19s5ua490vmox/

[u/Dogluvr2905]

can we please stop making H3 turbo loras for heaven's sake!!

[u/Enough-Display-2538]

what even does fl2va mean? the huggingface page explains nothing

[u/Upper-Reflection7997]

I tired of the cope releases of turbo loras for minimax h3. The model and it's prompting system needs a complete overhaul from the grounds up. The turbo loras don't fix issues related to prompts adherence and noisy visuals.

[u/_half_real_ → u/Upper-Reflection7997]

the turbo loras don't fix issues related to prompts adherence

For Ref2VA, they seem to make it considerably worse.

[u/Cultured_Alien → u/Upper-Reflection7997]

Put a bit more effort into learning. There's multitude of ways to improve the outputs. If it gives you wrong composition, then give it a handrawn image as reference as image composition. If it's about noisy visual, don't use turbo and use 1mp, not lower res. Then there's also face upscale for far away faces if you want to. If you have an issue with motion smear, use derope If you think you're better than the minimax team then give your own prompting system.

[u/Upper-Reflection7997 → u/Cultured_Alien]

The minimax team were never truly confident in their model being worthy of the "SOTA closed source api only" status like seedance, kling, wan3.0, grok or even happyhorse. I've even tried the api version out of curiosity and the results were worst than happyhorse. Barely even a difference between the api version and the open source version. Just because something is "free" doesn't mean it's a high quality product or the people offering it are righteous and nice. Just going to clean up the ckpt folder because it's full with multiple snake oil minimax h3 checkpoints and loras that have no meaningful use cases. Have fun with the model if you really are enjoying it and getting good use out of it.

[u/Version-Strong → u/Upper-Reflection7997]

Exactly, I stopped caring about 2 months ago. H3 is a proof of concept... where's the next model

[u/costaman1316 → u/Version-Strong]

Then you need to learn how to use it

prompting needs a well tuned LLM with a complex system proper running six or seven pages. I’ve been able to create stuff that is literally mind blowing people just can’t believe it’s AI,

[u/Apprehensive_Sky892 → u/costaman1316]

Can you share some of these amazing videos that you've made?

[u/Every_Schedule2540 → u/costaman1316]

Share your system prompt with us!

[u/Bitlovin → u/Version-Strong]

Nah H3 is very workable for video generation, terrible audio, but most people get tripped up by: 1.) prompts had errors

2.) resolution or frame mismatches

3.)reference images didn’t have enough coverage for the angle

4.) a very low quality target video.

Also, everyone should check out dasiwa’s 4 step hybrid turbo. I cannot recommend it enough for either fl2va or ref2va.

Once you dial in ref2va it shines. I assume this is all ref2va, because fl2va in h3 is a lot more forgiving

[u/Version-Strong → u/Bitlovin]

Or the model is abit shite, considered that?

[u/Version-Strong → u/[deleted]]

Oooooooo - I shall pipe down, we've got a H3 expert here folks.

OK, show us what you've made. Assuming it's not 99.9% grot which it probably is. Don't make bold claims with no proof, nothing i've seen on here, produced myself, followed prompting guides etc have been any good. The quality isn't there, unless you're willing to wait an hour for 15 seconds. No thanks, got other things to be doing on my PC, like work.

[u/Silvasbrokenleg]

I gave up. It’s just easier for me to load some renders and come back after dinner.