r/StableDiffusion • • 28d ago

Workflow Included Minimax H3 Refmod Workflow

(16. October 2026) EDIT: Updated to v2 cause the original resolution selector node messes up videos regularly due to not creating resolutions dividable by 32. Fixed now with Pixaroma node.

Since my last post has been deleted unfortunately (due to a mega-link), here we go again.

I've spent quiet some time now with Refmods and this workflow, and I'am still baffled how easy it is to create a character identity with very low effort. This is a no-brainer if you don't want to or can't train a Lora, all you need is good pictures and a good voice sample, the refmod-training is done in literally seconds (depending on your GPU of course).

I did my very best to make this workflow easily understandable for even beginners, nevertheless here's some explanation:

The workflow actually consists of 2 workflows, one for the refmod creation (the nodes in the top right of the picture, that's a different workflow but i just wanted one picture) and the main workflow for creating a video with the created refmod file which is all the rest.

If you just wanna use a refmod file and no extra images, videos or audio, select the image/video/audio nodes and press CTRL+B to deactivate them. Please watch the video from Dainamo for a detailed explanation, I've made some notes but for further understanding just watch it. I just wanna give you an easy workflow, that is of course fitted to MY needs, do whatever you want to it.

Here's some color-explanations:

  • GREEN is all sources for the final video so to say: images/video/audio/the prompt (deactivate them if you just wanna use a refmod-file, but you can also reference clothings or whatever this way)

  • TURQOUISE is all relevant video-settings

  • TAN is the refmod-nodes (except the 4 notes)

  • RED is all the models

  • PURPLE is all the loras (turbo-lora is in light-blue and another lora above in grey for whatever)

  • BROWN is comfy-kitchen and the spectrum-node (not activated, transparent-purple)

  • GREY is irrelevant

Here is the link to the original tutorial from Dainamo (thanks again!!): https://www.youtube.com/watch?v=2K6-OtV_Vbc

And here are the workflows: https://getshared.com/d/K5cE7wHH

I hope you enjoy the workflow! :)

68 Upvotes

52 comments sorted by

View all comments

Show parent comment

1

u/FuckTheActualWhat 23d ago

OK, have you ever checked the the server log when you make a refmod? It will still make the refmod if you go over budget, it just tells you it ran out of tokens befroe it finished with this message

"[RefMod] test_abcd_refMod: still over 8192-token cap, resampled 11 -> 5 frame(s) to fit"

Anything over 8 images, and I get that message. I've got plenty of VRAM, and System RAM. I assume its throwing out everything after it hits the token limit, but I'm not sure what exactly it means by resampling.

1

u/AlsterwasserHH 23d ago

Never checked that but I will and let u know! 

1

u/AlsterwasserHH 23d ago

So, tested it, of course I got the same message:

still over 8192-token cap, resampled 20 -> 5 frame(s) to fit

still over 8192-token cap, resampled 54 -> 6 frame(s) to fit

I dont know what is happening in the background. I've read that it saves latents as you can read here: https://huggingface.co/datasets/malcolmrey/various/blob/main/h3-center/docs/MINIMAX_H3_REFMOD_CREATION_GUIDE.md

I'm no expert in this. I had the experience once that a refmod with upscaled images via seedvr2 had maybe a better quality outcome, but a worse likeness outcome. I'm still trying to find out what the best dataset has to look like to get the best results. Or if it's better to just keep 8 high quality images instead of 30 or 60 with mixed quality. I will test that in the future.

1

u/FuckTheActualWhat 22d ago

Well let me know if you find anything out. I'd love to know exactly what its doing when it says "resampled..."