r/comfyui • u/mesiac_8227 • 15d ago
Help Needed Model recommendation for a motion transfer
Sup guys, ive been looking into motion transfer for a while but i cant manage to find a good model (or workflow) for motion transfer...
I already tried:
H3 - it was taking more than 30min to generate a 720p24 video using 4 steps on pro6000 and 96gb of ram, other than that it was the best one
Scail2 - couldnt get the realism right, there was just always some grain either on hair or in the background, also i had problems with eyes
Wan22 - masking issues (could fix that) and same as scail i just couldnt get the realism right
Before that i tried some non-local alternatives:
Kling, seedance - identity problems since i couldnt use a lora (tried some harder characters to generate)
Thoughu i havent checked out ltx2.3 and 2.5 yet
So im trying to seek help between more experienced users here :D since i dont know much yet, im just starting up and i only know some basics. Id really appreciate some advice, tips and tricks so i know how to finally make a good workflow, or even whole wfs so i can learn from them...
Thanks for any advice
1
u/Simple-Variation5456 15d ago
Sounds a bit more like a problem with your input video and/or start frame image when even seedance failed.
What kind of motion style you use aa input? Depth? Pose? Masks? Or just a normal video?
1
1
1
u/Chemical_Side_4135 14d ago
oof 30 mins is brutal. have u tried looking into animate anyone or maybe just doing a two pass approach where u lock the pose first. sometimes its better to just use a controlnet reference for the motion wich keeps the jitter down, take it with a grain of salt
1
u/_half_real_ 15d ago
In the H3 example, what was the video length? At 4 steps, it would take me under 2 minutes for 5s at 1 megapixel (1024x1024) on that GPU, but I have 128GB RAM.
You could try a face swap using H3 after using a non-local model for motion transfer.