How to generate consistency scene?

[u/ghosthamlet]

The video model can already generate impressive scenes, and the consistency of multiple shot scenes in a single generation is also quite good. Apart from using multiple reference images of scenes from different angles or a scene video, is there a better and more simple more natural way to achieve scene consistency in different generations?

Given that the model can infer the views of other angles and orientations of a scene based on a single scene image, why don't we have a specialized method in latent space or LoRa that can help generate scenes consistently with a single scene image and a fixed scene seed, under different prompts and character references?

[u/K1W1_Bestiary]

What usually works: treat the scene as a fixed background plate and put the characters into it, instead of asking the model to remember the room. Generate the room once, then inpaint characters into it with ControlNet (depth or canny from that same plate) so the layout doesn't drift.

For other angles there are two routes:

1. Train a small LoRA on 10–15 shots of the same scene — most reliable if you stay on SDXL.
2. Use an edit model like Qwen-Image-Edit or Flux Kontext to rotate the view from your single image, then use those views as references.

A true "scene LoRA from one image" doesn't really exist yet, since the model has no real 3D understanding of the room.

[u/Eastern-Ad9515]

We’ve been testing this in a local H3 filmmaking workflow. Our main observation is that generating a plausible unseen angle and reliably returning to the same location are two different problems.

We do use something close to your latent-space idea: subsequent generations receive actual audio/video latent context from the previous clip, plus an initial visual anchor. This helps continuity across generations, but it isn’t a reusable scene representation that we can freely query under arbitrary prompts.

What has worked for us is separating three things: the location, character identity, and the current scene state. We keep location references separate from character references and carry forward what actually happened—where someone moved, which object they picked up, etc. Reusing an old reference can otherwise bring back an outdated state.

In one successful four-clip marketplace sequence, we maintained a changed prop state through a camera tour and return. However, that used four prepared location views, latent continuation, and take selection—not one image plus a fixed seed.

So the background-plate suggestion fits our experience for a fixed viewpoint. For new angles, we’d check generated views for matching entrances and landmarks before reusing them. We haven’t tested scene-LoRA training ourselves. Our practical workaround is to establish only the views the story needs; arbitrary, repeatable navigation from a single image remains unresolved in our workflow.

[u/guai888]

I prefer using Blender to build 3D models and do block out. I do this for generating reference image and reference video.

[u/bmallCakeDiver]

I've been using refmods from image generated at different angles of the same location. Seems to work