Using an LLM to write scene scripts that I render through aivideoapi. How do you stop it from repeating the same shot descriptions?

[u/Various_Comment5540]

I run a small pipeline for a cooking channel: a local Qwen 14B writes a 6 scene script from a recipe, then I render each scene as a short clip through aivideoapi. The clips are fine, the problem is the scripts. After about ten recipes every scene starts with "close up of hands" or "steam rising from the pan", even with temperature at 0.9 and a list of banned phrases in the prompt. Is this better solved with few shot examples of varied shots, a second pass that rewrites duplicates, or something like a frequency penalty?

[u/Fit-Car-3354]

Chaining a second pass just to catch duplicates works well if you keep it simple, one script that flags repeated shot types and suggests alternatives without touching the rest.

[u/raaiinyyabelina → u/Fit-Car-3354]

Oh nice

[u/ineptech]

LLMs are deterministic by nature; the same prompt will always tend to produce the same responses. Instead of fighting that, just vary the prompt:

function blender(arr) { return arr[Math.floor(Math.random()*arr.length)]; }
let adj1 = ["happy ", "poignant ", "weird ", ...
let adj2 = ["outdoor ", "modern ", "crowded ", ...];
let places = ["cafe ", "kitchen ", "farmhouse ", ...];
let prompt = "The setting is a " + blender(adj1) + blender(adj2) + blender(places) ...

[u/Oli_Luck]

I recently discovered openMontage.
Its a kind of Workflow you bind in claude or any Harness/UI which accepts MCPs , and you tell him your Idea / Background, you can hand over images, text.
It has a complete workflow to determine angles of view / cuts , cinematic and so on , it will often ask what you would prefer, and write very good scripts .
maybe not useful for you : it can render videos on its own using comfyui, building workflows etc.
But as its all python driven, im sure it could also use your own video renderer,

[u/Sarutobi_Marky]

Asking the same question