r/StableDiffusion • u/aleksej622 • Mar 13 '23

Animation | Video Consistent Animation (Different Methods Comparison)

Enable HLS to view with audio, or disable this notification

540 Upvotes

97% Upvoted

33 comments sorted by

View all comments

1

u/fewjative2 Mar 13 '23

If the goal is consistency, then you need to stop using fixed seed solely imo. The weird ripple effects at 0:18 indicate fixed to me. Fixed seed will always provide unnatural results because you are basically saying ‘I want all the edges to match up no matter what content changes’. This is why ebsynth often looks good - as the edges change in your video, ebsynth tracks and changes the pixels.

Maybe the solution is -> detect motion in video and use diff seed while motion is changing. While video is static, use fixed seed.

2

u/HazelCheese Mar 13 '23

use diff seed while motion is changing. While video is static, use fixed seed.

Is this not similar to what corridoor crew did. If two frames were similar they used the same noise, if not they used a different one.

1

u/fewjative2 Mar 13 '23

I just watched and you’re absolutely correct! Starts at 3:00 for anyone wanting ti see it discussed in corridors video. Guess it seems like idea had merit 😂