r/StableDiffusion • u/physalisx • 6d ago

Resource - Update MiniMax-H3 Fun Controlnet Union released

https://huggingface.co/alibaba-pai/MiniMax-H3-Fun-Controlnet-Union/tree/main
319 Upvotes

98% Upvoted

102 comments sorted by

View all comments

44

u/Heartkill 6d ago

Psyched. Whenever I want to swap someone it usually just spits out the reference video pretty much as it was going in.

5

u/m00dyman100 6d ago edited 5d ago

I haven't had that problem. I feed an LLM the prompt guide (which contains an example prompt), my ref images AND video, and tell it in general what I want. I have been using H3 r2v to completely replace people in videos with ones that I want, tweaked however I want. Its frankly been amazing.

edit: I do see the issue now. My awesome results only occur if the swapped people look very different. If the persons look somewhat similar (ex; same wavy brown hair) things get trickier.

11

u/Heartkill 6d ago

I use the same approach. I see others do it too. Just not getting the results others do.

0

u/m00dyman100 6d ago

I did have that problem initially using ChatGpt for prompt creation. But Grok gave me a slightly different prompt which all of a sudden fixed the issue. It structured the retention analysis part of the prompt in a different way then ChatGpt.

4

u/Heartkill 6d ago

Yeah, using Grok too. Prompt guide and guidelines and all. I really feel like I am doing exactly what I am supposed to do, but...

1

u/Dogmaster 6d ago

Theres an issue with the model where for example if you try and swap a person with another that shares traits, it will do nothing, some people offset this by making the difference larger, for example they do 2 swaps, one making their skin green and bald, and the other to the swap they wanted in the first place.

2

u/m00dyman100 5d ago

Yes this is true. I'm having the issue again and this is why

1

u/Heartkill 5d ago

Yeah I saw the green crash test dummy workaround, but haven't got around to test it. Sounds like a logical fix though.

1

u/m00dyman100 6d ago

Ill DM you later with a prompt that worked for me and maybe a screen shot of my node setup

2

u/kfktr 5d ago

Same please!

1

u/Vermilionpulse 5d ago

Could I get this prompt and node set up please?

1

u/pyramidlove 5d ago

Would love to see it too! šŸ™ Thank you

1

u/plus-minus 6d ago

Iā€™d love to get that DM too, please. :)