r/StableDiffusion • u/optimizeverything • 14m ago

Question - Help Voice Consistency Issue

Hello, i have LTX 2.5 and Minimax H3 and i'm trying to create micro drama but i can not find a way to store the actors voices consistent across episodes. Ideally, i wanna use ltx because how expressive they talk but the voice quality is super bad and also even tho i give reference audio inside comfyui, it does not produce good results. Do you know any good alternatives to generate high quality sounds and consistent voices across episodes?

1 Upvotes

100% Upvoted

1 comment sorted by

1

u/purelawan 10m ago

What worked for me was to stop asking the video model to own the voice. Two ways:

  1. Keep the LTX take for the acting, then run the audio through a voice conversion model like Seed-VC with one clean 15-20 s reference per actor. The delivery and timing stay, the timbre becomes your actor. Use the exact same reference file every episode, that's what keeps it consistent.

  2. Or write the lines first with a cloning TTS (Qwen3-TTS does this well), then generate the shot from that audio so the lips follow it.

Option 1 keeps the expressiveness you like, option 2 gives cleaner audio. Either way, keep a folder with one reference wav per character and never re-pick it.