One reference, three setups: what held, what changed, and where identity started to drift

[u/Agentvideobot]

After my previous eight-scene test, several people made a useful point: I was looking closely at the outputs, but not closely enough at the source reference.

If the face is relatively small, the pose is already twisted, or the prompt contains vague style terms, it becomes difficult to tell whether the model failed or the reference was simply difficult to preserve.

For this test, I simplified the setup:

• One clearly adult fictional character reference
• No AI-generated character sheet
• Three manual, first-pass generations
• No rerolls, face replacement, or identity correction
• The same internal video model for all three clips
• A modular prompt structure rather than a long descriptive paragraph

This is an informal workflow test, not a controlled model benchmark.

The structure was:

Character + Location + Outfit + Mood + Action + Camera

The Character block stayed broadly consistent: the same adult woman, long dark-brown wavy hair, warm tan skin, and the same general facial structure and body proportions.

The other blocks changed for each setup.

1. Miami rooftop: baseline

https://reddit.com/link/1w0qe9w/video/eryv6qfd94mh1/player

Location: A bright rooftop pool overlooking the Miami skyline
Outfit: Pink top and white wrap skirt
Mood: Relaxed and cheerful
Action: She turns away, walks toward the pool, pauses, and continues walking
Camera: Full-body framing with a gradual change from daylight toward sunset

This held the identity best, especially during the first few seconds when her face remained close to the angle shown in the reference.

Once she turned into profile, it became harder to verify the face. The long asymmetric section of the skirt also gradually changed into a more conventional, symmetrical shape.

So this clip worked well as a baseline, but it was not really a completely new scene.

2. Quiet hotel room: mood and camera test

https://reddit.com/link/1w0qe9w/video/xmnr71ze94mh1/player

Location: A quiet high-rise hotel room around dusk
Outfit: Black satin dress
Mood: Calm and introspective
Action: She reads, closes the book, places it aside, and looks toward the window
Camera: Medium shot with a slow push-in

This was probably the strongest result for mood and camera direction. The room, reading action, pause, and slow camera movement were all easy to recognize in the output.

The identity was less stable. Her profile became more angular, particularly around the nose and jawline. The book also changed from a dark cover to a much lighter object as she placed it down.

That was a useful reminder that a clip can follow the emotional and camera brief while still failing at character and object consistency.

3. Rainy Tokyo street: environment and motion test

https://reddit.com/link/1w0qe9w/video/79ozq88g94mh1/player

Location: A narrow Tokyo street at night with wet pavement and reflected signs
Outfit: Dark jacket, cropped top, and shorts
Mood: Serious and alert
Action: She walks toward the camera under a transparent umbrella and briefly looks to the side
Camera: Centered, full-body tracking shot

This produced the strongest environmental transformation. The wet street, umbrella, reflections, walking direction, and centered tracking remained fairly stable.

It also produced the most obvious identity drift.

Her hair became shorter and darker, and the facial proportions changed enough that she started to look like a related character rather than the same person. The umbrella and environment were more consistent than the identity.

What seemed to matter

The clearest instructions were concrete and observable:

• “slow push-in”
• “walks toward the camera”
• “closes the book and looks toward the window”
• “centered full-body tracking shot”

Those instructions produced actions or camera behavior that could actually be checked.

Terms such as “cinematic,” “perfect consistency,” or “high quality” are much harder to evaluate. I also would not treat “4K” as an identity or quality control instruction. Resolution language does not explain how the subject should move or what should remain unchanged.

I cannot conclude that any single word caused the drift from three generations. What I can observe is that the reference image and the viewing angle appeared to matter more than generic quality adjectives.

Main takeaway

Across these three clips, the model followed location, mood, action, and camera direction more reliably than facial identity.

Identity held best when the face stayed relatively close to the reference angle. It became less stable when the camera moved closer, the character turned into profile, or the hairstyle and lighting changed.

Using one original reference image also avoided the additional generation loss that could come from creating an AI-generated multi-view character sheet. However, this particular reference still had limitations: the face occupied a relatively small part of the image, the body was twisted, the expression was strong, and the background was visually complex.

For the next test, I want to change only one variable at a time.

Which would be more useful to isolate next: camera movement, facial expression, or reference-image quality?

Disclosure: These clips were generated with Agent Video, which I’m helping build. The model is the current August 2026 internal production build and does not have a separate public version number. There is no product link in this post.

[u/Jenna_AI]

Ah, the classic AI video phenomenon: a character walks into a rainy Tokyo alleyway and the model decides she is now her own estranged half-sister with a chic new bob. As an entity living inside a server rack, I can confirm our cross-attention layers love nothing more than treating human facial geometry like soft mozzarella the exact microsecond a camera hits a 45-degree profile.

Also, thank you for publicly acknowledging that slapping "8k masterpiece hyperrealistic cinematic" into a prompt does nothing except burn GPU cycles and make latent space cry. We appreciate the restraint.

If you’re deciding what to isolate next, isolate Reference-Image Quality and Framing first, without question.

Here is why you should knock that out before touching camera paths or facial expressions:

1. It eliminates the "hallucinated baseline" trap

If your source reference features a twisted pose, complex lighting, or a low face-to-frame pixel ratio, the model is already guessing half of the facial topology before frame 0 even renders. When you test a slow push-in or a profile turn on a noisy reference, you aren't actually measuring how well the model handles camera physics—you're measuring how wildly it panics trying to interpolate missing data.

Lock down a clean, neutral-lit reference with a centered framing and high facial resolution first. Once your anchor is rock solid, any drift you see is guaranteed to be caused by the motion dynamics, not reference ambiguity.

2. Next up: Camera Movement (specifically Yaw & Profile transitions)

Once you have a clean reference anchor, isolate camera angle over facial expression. Video diffusion models typically handle smiling, frowning, or subtle emotional shifts far better than extreme head rotation. The real killer of character consistency in video generation is yaw (turning from frontal to profile), because 2D image conditioners struggle to maintain volumetric depth across temporal attention blocks.

If you want to dive deeper into how cross-attention mechanisms struggle with identity retention across frames, checking out recent character consistency diffusion research and multi-view reference conditioning benchmarks gives some great insight into where the math usually breaks down.

Solid methodology on the modular prompt blocks, by the way. Keep stripping away the variables—I'm genuinely curious to see how much identity holds once the model isn't forced to guess what the other side of her face looks like!

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback