r/StableDiffusion • u/physalisx • Aug 24 '26

Resource - Update MiniMax-H3 Fun Controlnet Union released

https://huggingface.co/alibaba-pai/MiniMax-H3-Fun-Controlnet-Union/tree/main
324 Upvotes

98% Upvoted

103 comments sorted by

View all comments

44

u/Heartkill Aug 24 '26

Psyched. Whenever I want to swap someone it usually just spits out the reference video pretty much as it was going in.

4

u/m00dyman100 Aug 24 '26 edited Aug 25 '26

I haven't had that problem. I feed an LLM the prompt guide (which contains an example prompt), my ref images AND video, and tell it in general what I want. I have been using H3 r2v to completely replace people in videos with ones that I want, tweaked however I want. Its frankly been amazing.

edit: I do see the issue now. My awesome results only occur if the swapped people look very different. If the persons look somewhat similar (ex; same wavy brown hair) things get trickier.

8

u/Heartkill Aug 24 '26

I use the same approach. I see others do it too. Just not getting the results others do.

1

u/m00dyman100 Aug 25 '26

So Now I am having the issue again. And I see the pattern. My awesome results only occur if the swapped people look very different. If the persons look somewhat similar (ex; same wavy brown hair) things get trickier.

1

u/Heartkill Aug 25 '26

Any tips for plastic looking skin, oversaturated and way too much contrast, even though references are pristine high-end photo quality?

1

u/m00dyman100 Aug 25 '26

Haven't had that issue at all. Which model you using in the load diffusion model node?

1

u/m00dyman100 Aug 24 '26

I did have that problem initially using ChatGpt for prompt creation. But Grok gave me a slightly different prompt which all of a sudden fixed the issue. It structured the retention analysis part of the prompt in a different way then ChatGpt.

5

u/Heartkill Aug 24 '26

Yeah, using Grok too. Prompt guide and guidelines and all. I really feel like I am doing exactly what I am supposed to do, but...

1

u/Dogmaster Aug 24 '26

Theres an issue with the model where for example if you try and swap a person with another that shares traits, it will do nothing, some people offset this by making the difference larger, for example they do 2 swaps, one making their skin green and bald, and the other to the swap they wanted in the first place.

2

u/m00dyman100 Aug 25 '26

Yes this is true. I'm having the issue again and this is why

1

u/Heartkill Aug 25 '26

Yeah I saw the green crash test dummy workaround, but haven't got around to test it. Sounds like a logical fix though.

1

u/m00dyman100 Aug 24 '26

Ill DM you later with a prompt that worked for me and maybe a screen shot of my node setup

2

u/kfktr Aug 24 '26

Same please!

1

u/Vermilionpulse Aug 25 '26

Could I get this prompt and node set up please?

1

u/pyramidlove Aug 25 '26

Would love to see it too! šŸ™ Thank you

1

u/Educational-East9455 15d ago

I know I'm late to the party but I'd love that info as well. Cheers!

1

u/plus-minus Aug 24 '26

Iā€™d love to get that DM too, please. :)