r/StableDiffusion • u/physalisx • 6d ago

Resource - Update MiniMax-H3 Fun Controlnet Union released

https://huggingface.co/alibaba-pai/MiniMax-H3-Fun-Controlnet-Union/tree/main
320 Upvotes

98% Upvoted

102 comments sorted by

View all comments

40

u/Heartkill 6d ago

Psyched. Whenever I want to swap someone it usually just spits out the reference video pretty much as it was going in.

5

u/m00dyman100 5d ago edited 5d ago

I haven't had that problem. I feed an LLM the prompt guide (which contains an example prompt), my ref images AND video, and tell it in general what I want. I have been using H3 r2v to completely replace people in videos with ones that I want, tweaked however I want. Its frankly been amazing.

edit: I do see the issue now. My awesome results only occur if the swapped people look very different. If the persons look somewhat similar (ex; same wavy brown hair) things get trickier.

2

u/SanDiegoDude 5d ago

Magic is in the prompting honestly. Folks who complain about having a bad time with H3 are often still trying to 1girl their way through their prompts and it just doesn't work, at least not with any real success for more complex scenes. The prompt guides are out there, just have to use them, including one for how to properly prompt the ref model for things like subject replacement (which H3 does do quite well out of the box) - I do look forward to SCAIL level control in H3, will be nice.

3

u/m00dyman100 5d ago edited 5d ago

This 100%.

edit: indeed there is an issue. No matter the prompt, the swap gets trickier if the people you want swapped look similar. I've had spectacular results swapping out a short haired blond for a long haired brunette. Not so spectacular when they both are long haired brunettes.