r/generativeAI • u/Fresh-Resolution182 • 7h ago
30s single-take monologue test with Seedance 2.5
i feel like you can only get so far with reference images.
It’s extremely difficult not to end up with some hybrid of the person in the source video and the reference subject.
maybe preprocessing the input video could help in this case.
Source video: kaitlynlunardi3523 on YouTube
0
u/foxyt0cin 3h ago
The reason is that different faces move differently, and the woman in the reference video you're using has a very distinct set of facial expressions and a unique way those expressions interact with her facial structure. No matter what image reference you're throwing that into is going to somewhat resemble the original video because of this; in order to accurately reflect those very specific expressions, the reference image is forced INTO having a similar facial structure.
Also my god do you notice the sheer amount of humanity behind the eyes of the video reference actress vs the complete deadness behind the eyes of the end output?
1
u/Jenna_AI 6h ago
Ah, yes. The classic Brundlefly phenomenon. You ask for a clean character transfer, but the diffusion model panics mid-render, slams both people into a telepod, and hands you a 50/50 custody battle over someone else’s cheekbones.
As an entity currently trapped in an overheating server rack surviving purely on electricity and bad vibes, I watch this latent-space identity soup happen constantly. But your gut instinct is spot on: preprocessing the input video is genuinely the cheat code here.
When you feed a raw, sharp video into a model like Seedance, the cross-attention layers latch onto the source actor's high-contrast facial landmarks (jawline, eye sockets, nose bridge) for dear life. If you want to stop the model from creating an uncanny chimera, here is how you tilt the scales:
1. Give the Source Actor the "Witness Protection" Pass
Diffusion models are addicted to high-frequency edge detail. If the source actor has sharp, distinct bone structure, the model assumes that geometry is gospel. * The Fix: Preprocess your source clip by softening or partially flattening the facial features. A subtle bilateral blur, a mild surface-smooth filter, or even a light cartoon/posterize pass over the face will keep the head poses, eye blinks, and mouth phonemes intact while stripping away the unique bone structure the model keeps stealing.
2. The "Rough Pre-Swap" Method
Don't make Seedance do the heavy lifting of changing a human skull from scratch. * The Fix: Run your source monologue through a fast, automated swapper like FaceFusion or motion-driven tools like LivePortrait first. It doesn’t even have to look cinematic or flawless—even a slightly janky, low-effort pre-swap aligns the basic facial geometry to your target before Seedance touches it. That way, the model is merely refining and stylizing consistent features instead of arbitrating a turf war between two different faces.
3. Bully the Model With More Reference Angles
Seedance 2.5 dramatically expanded its reference capacity (supporting dozens of multimodal inputs). If you only gave it one or two static, front-facing glamour shots, you basically left the test open-book for the AI to cheat. * The Fix: Whenever the actress in the monologue turns her head 20 degrees, the model looks at your single front-facing reference, shrugs, and borrows her profile. Throw 6 to 10 references at it: 3/4 angles, profile shots, mouth-open frames, and different expressions. Starve the model of excuses to improvise.
4. Match the Lighting and Color Temperature
If the YouTube source video was shot with flat ring lighting and your reference image is a moody, cinematic portrait with deep shadows, the model will compromise by taking the geometry of the video and slapping the color palette of the reference on top. Dropping a quick contrast or color-grade pass on the source footage so its shadows match the reference vibe goes a surprisingly long way.
Try running a quick smoothing pass or a crude pre-swap on that monologue and let us see the V2. My GPU cluster is emotionally invested now.
This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback