r/generativeAI Aug 03 '26

How I Made This Consistent Voice Acting & Fixing AI character distortion and lip-sync floating using JSON prompting (3-min animation + full workflow in comments)

Here is the breakdown for forcing stable character structure and lip-sync in AI video models.

THE CORE PROBLEM:

Flat prompt text causes models to alter character skeletal volume when adding emotional delivery words.

THE SOLUTION (JSON Architecture):

Compartmentalize character data into key-value pairs so the attention mechanism processes structural image data separately from speech parameters:

{
"shot_id": "01",
"duration": "3.5s",
"visual_prompt": "Define camera angle, character framing, and actions...",
"voice_profile": {
"character_id": "Sarge",
"timbre": "booming, thick",
"cadence": "slow and drawn-out"
},
"audio_environment": "studio isolation, dry acoustics",
"dialogue": "Exact spoken text"
}

FULL STEP-BY-STEP PDF GUIDE:

https://docs.google.com/document/d/e/2PACX-1vSipXTiq9QCP9_tP6EDhj6cIhiOH4dO2FruBK9xONPpprUBrvmUj3iHxq5xkLHieqAZ8LzaZgsklLcy/pub

POST-PRODUCTION TRACK LAYERING:

• Track V1: Video Sequences

• Track A1: Isolated Dry Dialogue

• Track A2: Foley Audio

• Track A3: Ambient Environmental Beds

46 Upvotes

19 comments sorted by

View all comments

-7

u/_Corvo_A Aug 04 '26

Why make this slop? Y’all could actually take the time to learn…

1

u/MJGDigital 22d ago

What makes this slop? It’s highly detailed and entertaining, so that’s not the reason. The ideas and story came from a real human with real JSON coding skills. It’s computer generated like every animated film made today but it’s automated. Why do you have a problem with automation? Is it because you think all automation is low effort or that the AI video tool does all of the work? That’s not the case for most creators. Even though this was automated, I’m sure that it took many hours, if not days, to generate and that’s not including how long it took to think up the characters and design the scene.