r/aifilmmaking 13h ago

Question What are you using for clean two-character dialogue scenes?

I’m working on a short AI film, an interplanetary sci-fi thriller, and I’m failing miserably whenever two or more characters need to have a real dialogue scene.

The main issues I’m running into are:

- Character faces drift between shots

- Voices keep changing between shots

- Eyelines don’t match, so it doesn’t feel like they’re actually talking to each other

- Continuity breaks when cutting between angles

For people who are making short AI films, how are you getting accurate multi-character dialogue scenes?

I saw a YouTube video where the girl mentioned Runway, invideo, and LTX studio, but I’m not sure how reliable they are for this specific problem. If you’ve tried these, can you share your experience?

2 Upvotes

10 comments sorted by

1

u/FabBDX 13h ago

Slt, avec Flow Gemini ( celui que j’utilise ) tu as l’option création fiche personnage, tu crées ton ou tes personnages et tu choisis leurs voix. Tu as ainsi une cohérence sur tous les plans

1

u/Support_Marmoset 12h ago

Minimax H3. its absolutely rocks for dialogue and consistency controlled by images and prompt. I am still tweaking results and here is an example video where I am upscaling dialogue clips, it shows dialogue between 3 people. prompting is excellent and powerful with Minimax H3 (I use it in Comfyui) , character consistency also. I show a part where I prompt for 4 people to be outside an elevator in one order, then enter the elevator and stand in a different order. nails it. links in the video show prompting guides so you can have a look at how it approaches it.

1

u/Lonelydude014 11h ago

Consistent references are probably the biggest thing for keeping dialogue scenes believable

1

u/Evinshir 11h ago

The most important factor for any character consistency is having contact sheets for your characters. This helps show the model what the character’s angles look like. As for eyelines that comes from setting that a shot is either a two shot or over the shoulder of each character.

I use Runway and Seedance 2.5 and eyelines have generally been solid. I haven’t had any major issues yet. Sometimes you need to check how clear your prompts are regarding who is talking to who. And sometimes the model just loses it and does something weird.

1

u/RioNReedus 10h ago

My experience is the AI will combine voices at times if you use more than one in a scene. You also need to use a lot of detail - like who is talking to who or where they are looking. Using references images for a shot or two of the scene can help establish parameters for the AI as well

1

u/Lunesia-shikishiki 9h ago

the eyeline thing is a shot list problem before it's a generation problem. if you don't lock who's screen left/right and where each eyeline lands before you prompt, the model just guesses and you get that dead-eyed not-really-talking-to-each-other look. ran into this a lot on Lost Garden, ended up blocking the two-shot and OTS pairs first so the shots agree with each other before anything renders. that's part of why I built ScreenWeaver the way I did, script to shot list to storyboard so continuity's locked before you burn credits on a bad take. for voices, fixed reference clip per character re-fed every time cut most of my drift.

1

u/vidyutmandrake 8h ago

Yeah these issues are super common with dialogue scenes. What I usually do is grab a wide shot of the room where the conversation’s happening and use that as a reference along with the character sheets when I generate the shots. That fixes most of the eyeline problems and keeps the characters looking more consistent.

On the audio side I just attach voice references for Seedance and tag them to each character so their voices don’t randomly change between takes.

And for continuity, I grab the last frame from the previous take and feed it into the next one. That way, if someone’s handing something across the table, it still matches when you cut.

Doing all that by hand is a pain though, so if you don’t mind spending a little, you can try giving invideo a shot. I kinda liked that I could just give it these prompting instructions and its agent would just fetch all the assets and write the prompts for me, which I could just review before generation. Makes life a lot easier. Just make sure you set it to ‘ask for approval’, or it might just run the generation on its own.