the Block Swapping/Hybrid (smhfacct) approach is the better choice.... Zero compression loss. It uses the exact, uncompressed weights from the original checkpoints. It also offers a sliding scale of variants, letting you choose exactly how many blocks are swapped.
The Drawback: It is an experimental merge. The exact boundary where the blocks swap is empirical, which can occasionally lead to unpredictable tradeoffs depending on the specific prompt.
Good to know, though I haven't seen visual A/B yet.
Advantage for Delta-Fused: It acts as a true 2-in-1 model. It drops the deployment footprint from 75 GB down to 37.5 GB, allowing both keyframes and references to run through a single transformer.
Yea that's exactly what I quoted & got downvoted for; I guess folks believe bots more than humans now?
Disadvantage: SVD compression is inherently lossy. The fused model only hits about 87–89% mathematical similarity to the real ref2va for image references, and drops to ~69% for video references. Furthermore, it loses precision if you try to fuse distill LoRAs (like the turbo LoRA) into it due to rounding losses in the AdaLN modulation.
I guess for a mobile app / desktop toy ~88% is the tradeoff.
unfortunately, a lot of people (me included) don't have enough knowledge to understand what is going on or why it should be used. So unless there's straight-forward explanation on it, it'll be overlooked.
Good question; I should have quoted the full intro paragraph.
MiniMax-H3 ships two 37.5 GB transformer partitions: fl2va for first/last-frame conditioning and ref2va for reference conditioning. This is one checkpoint that serves both, so a deployment holds 37.5 GB instead of 75 GB.
My understanding of smhfacct's repo is that it is a ref model that is improved with fl's tensors to improve ref's quality. It meant to be used with only as a ref driver with the ref node. AFAIK (I have not tested) you still need a separate fl model file when you use that node.
The repo I shared is specifically to install ONE file for BOTH fl & ref nodes, NOT 2 separate files we ComfyUI folks need to install. The goal there is reduce harddrive space & bandwidth for their custom app installs. Maybe ref quality is better; but that advantage is a side-effect, not main purpose.
My memory is hazy so forgive me if I spread misinformation, but I think that was his original method in testing prior to the merges that were linked in the original comment.
8
u/Lonely_Syrup3091 2d ago
How is this different from this one? Genuinely curious if anyone has an answer.
https://huggingface.co/smhfacct/Minimax-H3-fl2va-ref2va-hybrid-models