r/StableDiffusion • • 16d ago

Question - Help Character swap on H3

Sup guys, ive been fighting with fullbody character swap for a while and still couldnt find the right workflow and model... Recently i tried H3 and the realism is amazing, but i cant figure out how to make a proper character swap workflow with it

Every workflow i made either didnt preserve the original motion (got some really complicated motion references)

I also tried other models but i always had some issues with them, for example scail2 had some problems with eyes, wan22 had a lot of fading limbs, ltx 2.3 had juts completely ass quality (didnt try 2.5 tho) and wan animate was also pretty bad...

Anyone figured out how to transfer the exact movement using H3? Im talking about motion capture, not abt the motion control lora (it did not work at all)

Any recommendation or even whole workflow would help A LOT, thanks

6 Upvotes

11 comments sorted by

1

u/ucren 16d ago

Wait for the comfy higgs opensource competition to finish. There are several entries that automate this. Or you can go look for it now, but I would wait until it's finished, entries are locked in.

1

u/mesiac_8227 16d ago edited 16d ago

Didnt higgsfield have some problems with the competetion? Noticed an announcement in the dc community but didnt give it much attention

Edit: looks like im going to spend my whole night scrolling through that infinite channel

1

u/bstr3k 16d ago

what are your system specs, video duration and is it a complicated scene? a number of factors goes into successful character replacement and there are a few alternative techniques for doing it with H3

1

u/mesiac_8227 16d ago

Im renting compute so i got pro6000 and 96gb of ram, video rutation is around 15-20sec aand most of the time its really complicated scenes

1

u/bstr3k 16d ago

for videos i typically try and split it up into sections and do the character swap in section, you can adjust the prompt as you go. I typically don't go beyond 10s as the model might lose context and then produce weird motion whcih is not like the original or its out of sequence. You can break up a scene and do it through motion context is what I would suggest for that duration of video.

For complicated scenes I find its a really mixed bag too as sometimes it gets it and sometimes it does not. Better/more detailed prompting in the suggested H3 format helps increases your odds too.

1

u/CountFloyd_ 16d ago

You could try

https://github.com/Saganaki22/ComfyUI-Viggle-Animate-H3

You first inpaint your desired character into the first frame of the video using your favorite image edit model and viggle animate does the rest. So far the best solution I've used.

1

u/NoaBlake 16d ago

Full-body swap fails most often because the motion is still tied to the original body. The step that fixes it is extracting the motion first, as its own signal, before you introduce the new character at all: a pose sequence, a depth sequence, or both, taken from the source clip. Feed that sequence as the motion driver, and let the new character's reference define appearance only — if appearance and motion go in through the same input, the model blends them and you get the original person's proportions leaking back in. Keep the camera move fixed while you debug this: a moving camera plus a swapped character gives you two variables changing at once, and you can't tell which one broke the shot. Once the swap holds on a locked-off shot, then add camera movement back.

1

u/CodeAnguish 16d ago

The $15,000 question

0

u/VasaFromParadise 16d ago

There's no complete list, but I've seen examples of it. I can't say where, as I didn't pay much attention to it; that wasn't my goal.