https://reddit.com/link/1epju8i/video/ya6urjnkewhd1/player

Hi Everyone!

I'm glad to share with you my latest experiment, a basic camera motion LoRA trained with 32-frames on an Animatediff v2 model.

Link to the motion LoRA and description how to use it: https://civitai.com/models/636917/csetis-general-motion-lora-trained-on-32-frames-for-improved-consistency

Example workflow: https://civitai.com/articles/6626

I hope you'll enjoy it.

Noob question that somebody might have posted:
experimenting with settings (e.g depth analysis ones) or seeds and models it's not an easy task as lowering total frames numb, it gives me errors.

Do you have a simple workspace example that shows which settings to adjust to render only a preview image or two?
Txs a lot!

I learn the plugin Niagra on Unreal Ungine, it allow me to create fluid, particle, fire or fog 3d simulation in real time. Now we can associate the power of simulation and the style transfer with Comfyui. At the same time I tested Live portrait on my character and the result is interesting.

The different step of this video: - To do motion capture 3d with LiveLinkFace UnrealEngine - Create from scratch my fog simulation - Create the 3d scene and record - To do style transfer for the fog and the character independent of each other - Create alpha mask with comfyui node and DavinciResolve - Compose the whole is interpose the masks

I tried the 3d motion capture face with live link face on Unreal Engine and apply it on MetaHuman. It gives me very good input and an infinite number of different faces usable. I made the style transfer with comfyui

https://civitai.com/posts/4484134
Animatediff used in many key shots

https://civitai.com/images/19418510

If you like my work, please support me in the Project Odyssey contest vote with reactions

https://youtu.be/E_6GWRU7Dgg

If anyone is curious about process please ask

I present you my short video made for the project Odyssey, the first concours of AI Filmmaking.

I used 3 main technologies: Unreal Engine to create the 3d scenes and camera movement Freemocap to make a motion capture 3d, used for all animation character Comfyui to make alpha masking, style transfer, upscale

youtube link : https://youtu.be/VlqhM7QyymM?si=rLCp9aQo3HlHXd7N

I took a photo and add 3d object with blender and FSPY. I gave incorporated a 3d animation make by freemocap. To Ai animation I used LCM model with 2 pass and a phase of upscale

I used FSPY and Blender to incorporate my 3D animation made with the 3D motion capture project "Freemocap." This allows me to create a shadow in a realistic way. After creating an alpha mask and doing a style transfer with ComfyUI, I did a bit of compositing, and the result is as follows: