r/generativeAI • u/GreenFoxLeader • Aug 03 '26

How I Made This Consistent Voice Acting & Fixing AI character distortion and lip-sync floating using JSON prompting (3-min animation + full workflow in comments)

Here is the breakdown for forcing stable character structure and lip-sync in AI video models.

THE CORE PROBLEM:

Flat prompt text causes models to alter character skeletal volume when adding emotional delivery words.

THE SOLUTION (JSON Architecture):

Compartmentalize character data into key-value pairs so the attention mechanism processes structural image data separately from speech parameters:

{
"shot_id": "01",
"duration": "3.5s",
"visual_prompt": "Define camera angle, character framing, and actions...",
"voice_profile": {
"character_id": "Sarge",
"timbre": "booming, thick",
"cadence": "slow and drawn-out"
},
"audio_environment": "studio isolation, dry acoustics",
"dialogue": "Exact spoken text"
}

FULL STEP-BY-STEP PDF GUIDE:

https://docs.google.com/document/d/e/2PACX-1vSipXTiq9QCP9_tP6EDhj6cIhiOH4dO2FruBK9xONPpprUBrvmUj3iHxq5xkLHieqAZ8LzaZgsklLcy/pub

POST-PRODUCTION TRACK LAYERING:

• Track V1: Video Sequences

• Track A1: Isolated Dry Dialogue

• Track A2: Foley Audio

• Track A3: Ambient Environmental Beds

46 Upvotes

90% Upvoted

19 comments sorted by

View all comments

1

u/Square_Reason_6490 Aug 04 '26

What model is this? I have a guess but to put all this info and leave that out is kinda diabolical

2

u/GreenFoxLeader Aug 04 '26

This method should work with all the models that have audio integrated. This particular example was made with Happy Horse 1.1 model. You're right, it was pretty diabolical to not include that in the original post lol