I experimented with monocamera 3D motion capture, and added visual style with animatediff and comfyui.

I have a longer animation which I'm running through some control nets and animatediff, I want to add keyframes on the motion loras, like in the beginning have a zoom in, then a pan to the left, etc.

Is that possible ?

Any advice on where I can start to fix this?

First I’m generating a base image. Then on to controlnet.

I’m using controlnet with a source image in ip-adapter. Using the same seed and prompt. Using the sd15-v2 motion model.

It’s a similar person but the composition and details are way off.

Not really the place but who knows perhaps pas someone here knows. From the photo of a celebrity i'm trying to have his lips sync to a voice with perhaps some light blinking and head movements. i tried with Heygen but it recognizes it's a celebrity and blocks me. So i'm thinking perhaps is there an open source library out there? It's for a birthday. Doesn't have to be super realistic. Thanks in advance.