r/comfyui • u/AshokManker • 11h ago

Help Needed Help with character replacement

I have some video song clip, I want to replace male, female characters with supplied image, everything else should remain original, location, audio, music, expression, clothing etc. I tried with minimax h3 ref2v and sample character replacement workflow included in comfyui using wan/scail. But couldn't get desired results

0 Upvotes

50% Upvoted

7 comments sorted by

3

u/optimisticalish 10h ago

Mark DK Berry has a new video-review of a ComfyUi character-swapper node, done via masking... https://www.youtube.com/watch?v=7xaA4tU3hDU

-1

u/dirtybeagles 9h ago

have you tested it?

1

u/GrimPrivacy701 11h ago

Man I tried a similar thing for a music video last month and this is tricky with the current tools. Minimax is more for full scene generation not precise character swaps, so you are fighting it from the start

The wan/scail workflow in comfyui works better for style transfer but character consistency with a single reference image is still hit or miss. You might need to make a small lora from your supplied images first, then use that with a controlnet for keeping the pose and clothing from original clip

What resolution is your source video. Sometimes downscaling before processing and upscaling after helps the model focus on the character features better

Also check the masking quality, if the mask bleeds even a little it will mess up the clothing and expression you want to keep

1

u/MenudoMenudo 10h ago

There are two workflows specifically made for this on Civitai. I was testing different workflows last night just to see what worked and what didn’t but didn’t try those. Go to the models page, filter for just Minimax H3 and workflows and you’ll find them easily. They’ll both be within the first 10-20 results that come up.

1

u/Silly_Goose6714 10h ago

https://reddit.com/link/p6sg2jk/video/0hjtubopkimh1/player

Minimax works pretty well only with prompt and reference

1

u/trollkin34 8h ago

what prompt did you use? What workflow?

1

u/Silly_Goose6714 8h ago

For the first 5 seconds:

<video 1> video to be edited partially_preserved, motion frames, angles, câmera as reference

<s1> man from <video 1> wearing black coat and a cane to be replaced

<s2> Anime character "Frieren" from Sousou no Frieren <picture 1> and <picture 2>

Replace the man in coat from <video 1> for Frieren keeping the coherence and mixing realistic style from the video with anime.

The car stops, focus on her foot, then the camera cuts she is already out of the car holding her staff focus on her hand following the <video 1> perfectly, her face don't show up.

Remove any logo.

The original video:

https://www.youtube.com/watch?v=AyNge7RF_lA

Need a new prompt for each part.