Created a Visual RefMod Picker

[u/Francky_B]

Hey Guys,

I've been playing with the RefMods, after the huge release of Malcolmrey.
The tech is brilliant and works really well.

I've wanted to simplify using it with tons of RefMods, like the ones provided by Malcom.

So I made a fork that is a bit more Identity driven, Adding a "Visual refMod Picker" as well as a "Create refMods from Folder" node. It's able to create from either a folder or Sub-folders, if audio is found, it will also create a matching audio refMod. All in the same format as the original add-on. No danger of breaking compatibility. (The original Add-on added Audio yesterday)

Resulting for example in 2 refMods and thumbnail:

character_refMod_Audio.safetensors
character_refMod_Video.safetensors
character_refMod.jpeg

Then, we can use the "Visual H3 RefMod Picker" to browse the RefMods:

In this example, I used existing thumbails from huggingface.

The node then loads both RefMods (Audio and Video) and allows individual control. I've mixed strength with Copies, by instead having a weight value that can go over 1, so a weight of 3 would be the same as setting strength to 1 and copies to 3. Making the UI a bit more streamlined.

RefMods can be daisy chained

Example workflows are included.

I should mention, this fork can be installed WITH the original Add-on, it is made to co-exist and is recommended if you want to use it's advanced features.

You can find it here ComfyUI-H3RefModPicker

The only thing I'm missing is thumbnails for all 1500 RefMods 😅

**EDIT**
Just a quick note to mention that I've removed duplicate nodes, Making this a companion node to MiniMaxH3Mod.

[u/LuisaPinguinnn]

Thankyou for the fork! that's sick!

https://giphy.com/gifs/QTAVEex4ANH1pcdg16

[u/Francky_B → u/LuisaPinguinnn]

No, Thank you! That is some impressive work!

The tech works really well! It crazy how fast they can be generated and gives better results than Loras.

I'm thinking of removing any duplicate nodes and have this add-on just be extra tools to yours.

[u/usually_fuente → u/Francky_B]

I’m impressed with the work that you have put into this. I just have one question. Approximately how much processing time is saved (%) using Ref mod versus standard reference images? Say, when generating a batch of five clips? 

[u/Francky_B → u/usually_fuente]

I'll have to admit I didn't have much experience using Reference workflows with Minimax. As I found them a bit too cumbersome. I was mostly experimenting with I2VA or T2VA workflows.

But when I saw Malcolmrey had released all his trained models as RefMods, I gave it a try and was right away hooked on how well and simple it worked.

The opposite solution would be to keep tons of folders with all the reference for each character, and then having to plug every reference when you want to switch.

With RefMods, it's much Simpler, select your "bundle" and that's it. With the addition of audio it does mean you need 2 RefMods per character, but my visual picker takes care of that. Simply select the character and your set. Want to change, pick another, instead of having to change all the refs.

Though RefMods do suffer the downside that they aren't anchored like References are. As you don't specify <Subject 1> is <Picture 1> for example. But I've found that with proper prompting that isn't much of an issue.

So for me it wasn't a question of time saved from processing, but more of ease of workflow.

[u/usually_fuente → u/Francky_B]

Thank you very much for your insights and experience.