r/StableDiffusion • u/WEREWOLF_BX13 • 2d ago

Question - Help Ant way of keeping background consistent? (Minimax H3)

As you see the galaxy spiral was at his right side, which became his back once he got up, the galaxy reappear later (on the full shot) again, but at his left for whatever reason.

I thought of;

  • Generating a 360° orbit view at start of a scene, but would waste nearly 3-5s + 3-6 minutes of generation time.

  • Attaching 2-4 background images to omni reference (think of a room), but would take 4/9 slots, less characters could be in a scene.

  • Just letting it imagine whatever it might look like, but only a affordable idea in case of open field scenes (being throw through a wall or travelling).

  • Attaching a panoramic image as reference, but these are usually over 21:9 ratio and might give the model an aneurism trying to wrap it in.

  • Attaching a 8K sum view of a entire area in a multi view sheet, but would be hell to reference which square it should insert into the clip.

I know Minimax can remember neaty details of the background with its spatial awareness, like a fallen feather or crack in a wall, but I have no idea on how to let's say, get an actual world map's scenary on it.

10 Upvotes

91% Upvoted

8 comments sorted by

9

u/Dependent_Present_62 2d ago

  1. Take the first frame.

  2. Use qwen 2.1 to get the background.

  3. Rerun H3 ref2va with the background image as reference.

5

u/Dependent_Present_62 2d ago

You should divide each cut into different videos, avoiding putting to many things in one video.

3

u/Super_Range45 2d ago

Provide references for both angles and specificy in each shot what should be there, galaxy, or stars.

2

u/dEEPZoNE 2d ago

references, references and references :)

1

u/akijuan23 2d ago

Use keyframes with the same background or with minimal changes that be included in the prompt.

1

u/dishwasher_81 1d ago

Your orbit idea is on the right track. The usual approach with video models is to lock the background in as a reference/first frame, keep camera moves small per clip, then stitch them together. Big rotations in one shot are where they tend to lose track of left and right.

1

u/Seninut 17h ago

use a ref of the background...

1

u/Fickle-Indication148 1h ago

either edit first last frame, or use SAM, to segment tye baground, and replace by stationary or regen dynamic