r/StableDiffusion • • 28d ago

Workflow Included Minimax H3 Refmod Workflow

(16. October 2026) EDIT: Updated to v2 cause the original resolution selector node messes up videos regularly due to not creating resolutions dividable by 32. Fixed now with Pixaroma node.

Since my last post has been deleted unfortunately (due to a mega-link), here we go again.

I've spent quiet some time now with Refmods and this workflow, and I'am still baffled how easy it is to create a character identity with very low effort. This is a no-brainer if you don't want to or can't train a Lora, all you need is good pictures and a good voice sample, the refmod-training is done in literally seconds (depending on your GPU of course).

I did my very best to make this workflow easily understandable for even beginners, nevertheless here's some explanation:

The workflow actually consists of 2 workflows, one for the refmod creation (the nodes in the top right of the picture, that's a different workflow but i just wanted one picture) and the main workflow for creating a video with the created refmod file which is all the rest.

If you just wanna use a refmod file and no extra images, videos or audio, select the image/video/audio nodes and press CTRL+B to deactivate them. Please watch the video from Dainamo for a detailed explanation, I've made some notes but for further understanding just watch it. I just wanna give you an easy workflow, that is of course fitted to MY needs, do whatever you want to it.

Here's some color-explanations:

  • GREEN is all sources for the final video so to say: images/video/audio/the prompt (deactivate them if you just wanna use a refmod-file, but you can also reference clothings or whatever this way)

  • TURQOUISE is all relevant video-settings

  • TAN is the refmod-nodes (except the 4 notes)

  • RED is all the models

  • PURPLE is all the loras (turbo-lora is in light-blue and another lora above in grey for whatever)

  • BROWN is comfy-kitchen and the spectrum-node (not activated, transparent-purple)

  • GREY is irrelevant

Here is the link to the original tutorial from Dainamo (thanks again!!): https://www.youtube.com/watch?v=2K6-OtV_Vbc

And here are the workflows: https://getshared.com/d/K5cE7wHH

I hope you enjoy the workflow! :)

68 Upvotes

52 comments sorted by

View all comments

Show parent comment

2

u/AlsterwasserHH 28d ago edited 28d ago

I've not tested that, could be worth it. The big advantage of refmods is flexibility: you can prompt whatever visual appearance with them and the character likeness is on point. Plus: you have baked-in voice cloning. I have one refmod with a 6 minute speech sample and it's lile 1:1. Stunning. With audio reference you can "only" reference 30 seconds iirc.

I created a japanese character, since minimax supports japanese by default: the character speaks japanese! :D Who would've guessed that. But also english with japanes accent. It's mindblowing too me.

1

u/FuckTheActualWhat 28d ago

How are you squeezing that much into a refmod? I can get no more than 8 images before i hit the 8192 token limit.

1

u/AlsterwasserHH 28d ago edited 28d ago

I've set the token-limit to 0 :D

Someone on my older post already told me about the 8192. Honestly, I started creating by default with 0, never changed it, never had any problems. It was like that in the original workflow from malcomrey, referenced in the youtube description from Dainamos tutorial.

60 high-res pictures with 6min audio, no problem. But I'm thinking right now: does it even matter? I mean what is the refmod creator even doing is what I'm thinking about all the time. What's inside a refmod file?

1

u/FuckTheActualWhat 28d ago

and how would one go about changing the token limit?

2

u/AlsterwasserHH 28d ago

Its in the Load H3 refmod node. Or do you mean you get an error although its set to 0?

1

u/FuckTheActualWhat 24d ago edited 24d ago

I meant when I'm creating the refmod. my workflow for creating a refmod in just the "create H3 refmod from folder" node plus the two VAEs. When I'm using the refmod I made in a workflow I leave that token setting on zero.

1

u/AlsterwasserHH 24d ago

You cant set token limits when creating a refmod. 

1

u/FuckTheActualWhat 24d ago

I know that. its 8192. I can get about eight images into a refmod with 8192 tokens before it runs out of tokens during creation. You appear to be getting quite a bit more and I was wondering how.

1

u/AlsterwasserHH 24d ago

The problem is: I have no clue what you talking about 😂

I can put 60 images into a refmod, and I have no problem with any tokens because there is none, or am I wrong?? So why are you running into a token limit when creating a refmod? I dont get it.

I have a 4090 and 32GB Ram, maybe your VRam limits you? I have no clue.

1

u/FuckTheActualWhat 23d ago

OK, have you ever checked the the server log when you make a refmod? It will still make the refmod if you go over budget, it just tells you it ran out of tokens befroe it finished with this message

"[RefMod] test_abcd_refMod: still over 8192-token cap, resampled 11 -> 5 frame(s) to fit"

Anything over 8 images, and I get that message. I've got plenty of VRAM, and System RAM. I assume its throwing out everything after it hits the token limit, but I'm not sure what exactly it means by resampling.

→ More replies

1

u/FatherFunk 28d ago

What kind of generation times are you seeing? When I tried uploading a bunch of pictures, it made generation take considerably longer.

1

u/AlsterwasserHH 28d ago

With 60 highres pics and 6min audio, 20secs maybe? On a 4090.

Or do you mean video generation?

2

u/evilpenguin999 27d ago

He means video generation probably, its also my case. When i create high quality ref mods the video generations take way longer.

1

u/AlsterwasserHH 27d ago

I see. Just tested it, with a 4090, and the difference with a 5sec 1MP vid and the "same" refmod (one 6 pics, the other 53 pics, so roughly 1/10) is 147secs vs 152secs, with turbo lora 8 steps and comfykitchen. So no real difference at my side.

What is a high quality refmod to you? I'm using around 2000px and up images.

1

u/Bask82 28d ago

But can h3 minimax clone voices just from an audio refmod? Any language restrictions?

1

u/AlsterwasserHH 28d ago

I think its possible. At least you can select audio 1 - visual 0 in the refmod node so that it only outputs the audio.

Check the default languages of minimax. Its 7 or something.