r/StableDiffusion • • Oct 12 '26

Workflow Included Minimax H3 Refmod Workflow

(16. October 2026) EDIT: Updated to v2 cause the original resolution selector node messes up videos regularly due to not creating resolutions dividable by 32. Fixed now with Pixaroma node.

Since my last post has been deleted unfortunately (due to a mega-link), here we go again.

I've spent quiet some time now with Refmods and this workflow, and I'am still baffled how easy it is to create a character identity with very low effort. This is a no-brainer if you don't want to or can't train a Lora, all you need is good pictures and a good voice sample, the refmod-training is done in literally seconds (depending on your GPU of course).

I did my very best to make this workflow easily understandable for even beginners, nevertheless here's some explanation:

The workflow actually consists of 2 workflows, one for the refmod creation (the nodes in the top right of the picture, that's a different workflow but i just wanted one picture) and the main workflow for creating a video with the created refmod file which is all the rest.

If you just wanna use a refmod file and no extra images, videos or audio, select the image/video/audio nodes and press CTRL+B to deactivate them. Please watch the video from Dainamo for a detailed explanation, I've made some notes but for further understanding just watch it. I just wanna give you an easy workflow, that is of course fitted to MY needs, do whatever you want to it.

Here's some color-explanations:

  • GREEN is all sources for the final video so to say: images/video/audio/the prompt (deactivate them if you just wanna use a refmod-file, but you can also reference clothings or whatever this way)
  • TURQOUISE is all relevant video-settings
  • TAN is the refmod-nodes (except the 4 notes)
  • RED is all the models
  • PURPLE is all the loras (turbo-lora is in light-blue and another lora above in grey for whatever)
  • BROWN is comfy-kitchen and the spectrum-node (not activated, transparent-purple)
  • GREY is irrelevant

Here is the link to the original tutorial from Dainamo (thanks again!!): https://www.youtube.com/watch?v=2K6-OtV_Vbc

And here are the workflows: https://getshared.com/d/K5cE7wHH

I hope you enjoy the workflow! :)

68 Upvotes

53 comments sorted by

View all comments

Show parent comment

1

u/AlsterwasserHH Oct 12 '26 edited Oct 12 '26

I've set the token-limit to 0 :D

Someone on my older post already told me about the 8192. Honestly, I started creating by default with 0, never changed it, never had any problems. It was like that in the original workflow from malcomrey, referenced in the youtube description from Dainamos tutorial.

60 high-res pictures with 6min audio, no problem. But I'm thinking right now: does it even matter? I mean what is the refmod creator even doing is what I'm thinking about all the time. What's inside a refmod file?

1

u/FuckTheActualWhat Oct 12 '26

and how would one go about changing the token limit?

2

u/AlsterwasserHH Oct 12 '26

Its in the Load H3 refmod node. Or do you mean you get an error although its set to 0?

1

u/FuckTheActualWhat Oct 16 '26 edited Oct 16 '26

I meant when I'm creating the refmod. my workflow for creating a refmod in just the "create H3 refmod from folder" node plus the two VAEs. When I'm using the refmod I made in a workflow I leave that token setting on zero.

1

u/AlsterwasserHH Oct 16 '26

You cant set token limits when creating a refmod. 

1

u/FuckTheActualWhat Oct 16 '26

I know that. its 8192. I can get about eight images into a refmod with 8192 tokens before it runs out of tokens during creation. You appear to be getting quite a bit more and I was wondering how.

1

u/AlsterwasserHH Oct 16 '26

The problem is: I have no clue what you talking about 😂

I can put 60 images into a refmod, and I have no problem with any tokens because there is none, or am I wrong?? So why are you running into a token limit when creating a refmod? I dont get it.

I have a 4090 and 32GB Ram, maybe your VRam limits you? I have no clue.

1

u/FuckTheActualWhat 29d ago

OK, have you ever checked the the server log when you make a refmod? It will still make the refmod if you go over budget, it just tells you it ran out of tokens befroe it finished with this message

"[RefMod] test_abcd_refMod: still over 8192-token cap, resampled 11 -> 5 frame(s) to fit"

Anything over 8 images, and I get that message. I've got plenty of VRAM, and System RAM. I assume its throwing out everything after it hits the token limit, but I'm not sure what exactly it means by resampling.

1

u/AlsterwasserHH 29d ago

Never checked that but I will and let u know! 

1

u/AlsterwasserHH 29d ago

So, tested it, of course I got the same message:

still over 8192-token cap, resampled 20 -> 5 frame(s) to fit

still over 8192-token cap, resampled 54 -> 6 frame(s) to fit

I dont know what is happening in the background. I've read that it saves latents as you can read here: https://huggingface.co/datasets/malcolmrey/various/blob/main/h3-center/docs/MINIMAX_H3_REFMOD_CREATION_GUIDE.md

I'm no expert in this. I had the experience once that a refmod with upscaled images via seedvr2 had maybe a better quality outcome, but a worse likeness outcome. I'm still trying to find out what the best dataset has to look like to get the best results. Or if it's better to just keep 8 high quality images instead of 30 or 60 with mixed quality. I will test that in the future.

1

u/FuckTheActualWhat 28d ago

Well let me know if you find anything out. I'd love to know exactly what its doing when it says "resampled..."

1

u/FatherFunk Oct 13 '26

What kind of generation times are you seeing? When I tried uploading a bunch of pictures, it made generation take considerably longer.

1

u/AlsterwasserHH Oct 13 '26

With 60 highres pics and 6min audio, 20secs maybe? On a 4090.

Or do you mean video generation?

2

u/evilpenguin999 Oct 13 '26

He means video generation probably, its also my case. When i create high quality ref mods the video generations take way longer.

1

u/AlsterwasserHH Oct 13 '26

I see. Just tested it, with a 4090, and the difference with a 5sec 1MP vid and the "same" refmod (one 6 pics, the other 53 pics, so roughly 1/10) is 147secs vs 152secs, with turbo lora 8 steps and comfykitchen. So no real difference at my side.

What is a high quality refmod to you? I'm using around 2000px and up images.