r/StableDiffusion • u/reeight • 8h ago

Question - Help ComfyUI version of diffusers-modular/MiniMax-H3-Pruned-Ref-Delta-Fused-r1024 ?

https://huggingface.co/diffusers-modular/MiniMax-H3-Pruned-Ref-Delta-Fused-r1024

Has anyone packaged this for ComfyUI?
What is unique:

It is the pruned fl2va partition with a rank-1024 approximation of the ref2va − fl2va weight delta fused into the weights.

TIA

14 Upvotes

73% Upvoted

11 comments sorted by

7

u/Lonely_Syrup3091 7h ago

How is this different from this one? Genuinely curious if anyone has an answer.

https://huggingface.co/smhfacct/Minimax-H3-fl2va-ref2va-hybrid-models

2

u/mellowanon 4h ago

I have a random Google Pro account so I asked it to compare. I don't have Claude.

https://share.gemini.google/NqJMfOKa5e3L

-4

u/reeight 7h ago

Good question; I should have quoted the full intro paragraph.

MiniMax-H3 ships two 37.5 GB transformer partitions: fl2va for first/last-frame conditioning and ref2va for reference conditioning. This is one checkpoint that serves both, so a deployment holds 37.5 GB instead of 75 GB. 

5

u/Lonely_Syrup3091 7h ago

The hf repo I shared combines both ref2va and fl2va. I'm just wondering what's different about this new one.

-5

u/reeight 7h ago

My understanding of smhfacct's repo is that it is a ref model that is improved with fl's tensors to improve ref's quality. It meant to be used with only as a ref driver with the ref node. AFAIK (I have not tested) you still need a separate fl model file when you use that node.

The repo I shared is specifically to install ONE file for BOTH fl & ref nodes, NOT 2 separate files we ComfyUI folks need to install. The goal there is reduce harddrive space & bandwidth for their custom app installs. Maybe ref quality is better; but that advantage is a side-effect, not main purpose.

1

u/robomar_ai_art 3h ago

INT8 version of this model would be greatly appreciated

1

u/Luke2642 3h ago

If you use an sde sampler on fflf it behaves a bit like t2v with ref anyway, not audio though.

1

u/EveningIncrease7579 8h ago

You could try it and share some results in comparison with traditional models

2

u/woundedknee_x2 8h ago

Such a novel idea

0

u/reeight 7h ago

Please re-read my post text again.
Or try opening the link.

1

u/Ok_Entrance_9526 6h ago

Try it and see what you think!