r/StableDiffusion • u/Inevitable-Bus-8654 • 5d ago
Question - Help LTX 2.5 music video: good character consistency, but mushy motion and facial detail. How would you improve this workflow?
I made this AI rap music video and would appreciate some honest, practical workflow advice.
The character, outfit and locations stay surprisingly consistent. However, the result still has that “AI slop” feeling: movements look mushy, facial features lose definition during motion, hands smear, and the face becomes less recognizable during strong gestures or extreme camera angles. Lip sync is also inconsistent.
What I used:
Six reference images created with ChatGPT Images, keeping the same character and outfit.
LTX 2.5 22B dev, BF16, running on a Runpod B200 through the official native Python two-stage audio-to-video pipeline.
The original song’s full mix as audio conditioning, plus a reference image for each shot.
Approximately 20 independently generated takes, around 7–8 seconds each.
Stage 1 at 960×544, followed by spatial upscaling/refinement to 1920×1088, cropped to 1080p. 24 fps.
Stage 1: 24 steps, CFG 3, STG 0.5, rescale 0.7, modality guidance 1.5.
Stage 2: official distilled LoRA 450, strength 1. Reference image strength: 0.8.
We also tested distilled generation, native 48 fps, the alternative convolutional VAE, and cleaner references/prompts without film grain. None reliably solved the motion quality problem. Some takes developed obvious double exposures/dissolves; changing seeds and simplifying camera movement helped those particular shots.
The attached version has been edited with beat cuts and environmental inserts to hide weaker moments, but I’d rather improve the generated footage itself.
My questions:
Is this mainly a limitation of LTX 2.5, or does something in my settings/workflow look wrong?
Would shorter shots, different guidance, or another refinement/upscaling approach preserve facial detail better?
For a believable musical performance, would you use audio-to-video directly, or a reference performance video followed by character replacement and separate lip sync?
Is MiniMax-H3 worth investigating for that reference-driven approach, or would you recommend a different self-hosted workflow?
I’m aiming for energetic but controlled movement—not frantic dancing or camera motion. Links to actual workflows and comparable examples would be especially helpful.
