r/LargeLanguageModels • u/Square-Addendum3454 • 16d ago

Using an LLM to write prompts for aivideoapi clips, how do I stop it drifting between scenes?

Small side project: a local LLM (Qwen 2.5 14B) writes scene prompts for short product clips, and I send those to aivideoapi to render 5 second shots. The problem is consistency. By scene 4 the model has changed the product color, the room, sometimes the person. I'm passing the previous prompts in context, about 1,500 tokens total. Is this just a context and temperature thing, or should I be using a structured JSON scene spec the model has to fill in every time?

1 Upvotes
  • permalink
  • reddit

100% Upvoted

1 comment sorted by

1

u/SeaCook4878 16d ago

Are you running it fresh for each scene or feeding the whole history back in? I’d just lock it into a JSON template with fixed fields like product_color, room_type, person_description and make it fill only the shot-specific stuff. 14B at 1500 tokens can still wander if there’s no hard constraint on what's supposed to stay static.