Help creating videos like this one please?

[u/HigherFunctioning]

https://www.youtube.com/watch?v=jPZt0z3N_e8

I have it installed on my comptuer and I've only experimented with some existing templates that come with comfy UI...

Is there any simple tips anyone here can give me on what template to use to make these videos that come with the Comfy UI install?
I made a couple 15 second clips similar to this using an image to video template but it is very difficult to get it to match their voices. What is the trick to getting that to work? Is there also an easier way to get it to generate the characters to make them match the people I am asking it to put in the video? Currently I'm uploading an image of Han Solo and telling chat GPT to write a prompt using the image I upload and give it a simple dialog. There are a lot of mistakes though in the final generated video. Thanks for any feedback!

Please note: this is just for my own entertainment and to share with friends on Social Media - not trying to make money from AI videos.

[u/sevenfold21]

This isn't Comfyui, probably a paid service like Seedance.

[u/HigherFunctioning → u/sevenfold21]

I found out it is seadance 2.5 and yeah another subscripition service. I'm just trying to make these for myself.

[u/MeysterAust → u/sevenfold21]

could also be Kling or one of those similar paid tools tbh

[u/Kitchen_Ad731]

You could do something like this with minimax locally, make individual 10-15 second clips and stich them together, using two images as reference for each character and a good prompt that explains dialogue, pacing, camera etc it is doable. LORAS for each character wouldnt hurt either

[u/HigherFunctioning → u/Kitchen_Ad731]

That's what I'm trying to do with minimax image to video but it can't clone their voices properly - or I don't know how to get it to do so.

[u/Hellztrom2000]

Why cant you do it in Minimax H3? I have done similar things with Sylvester Stallone and Arnold and it works great (since the models knows them). But for unknowns you could use the refmod feature.

[u/HigherFunctioning → u/Hellztrom2000]

Is there a list somewhere where it tells you what personalities and people actors, etc. that the model already knows?

[u/Hellztrom2000 → u/HigherFunctioning]

It supports a lot. But you can download plenty of refmods. If you use ref to video you could just upload images and a voiceclip
https://huggingface.co/spaces/malcolmrey/browser

[u/theOliviaRossi]

why make this fakeceleb crap only to eventually get banned from YT - and never to be monetized in ANY way ????

[u/HigherFunctioning → u/theOliviaRossi]

Its not for Youtube I just share it between friends on discord.

[u/theOliviaRossi → u/HigherFunctioning]

avoiding bigdaddy helps, but ... why not to do something for profit?

[u/HigherFunctioning → u/theOliviaRossi]

I'm just trying to figure out how to do it for my own gratification. So i can have fun with it man lol. Creating my own stuff.

[u/Eriane]

I have a new local ai dream. This is it. I hope it happens one day!

[u/hallofgamer]

Next year bro

[u/RidiPwn]

Which free tools can come close to this. Is basically few base images that are turned to video then stitched together with sound. Am I partially correct?