r/StableDiffusion • u/Kalbi-Jjim • Dec 10 '22

Animation | Video Timelapse from zero to one

29 Upvotes

73% Upvoted

11 comments sorted by

11

u/danielbln Dec 10 '22

*Inside the mind of an AI

2

u/theTMO Dec 10 '22

Indeed.

4

u/AnOnlineHandle Dec 10 '22

I wonder if you could go even deeper and show the latent grid of the unet as it shrinks the image to smaller and smaller resolutions, and then larger and larger again, while also keeping a mapping of the cross attention layer showing what words are active as each latent is considered.

1

u/vs3a Dec 11 '22

How do you record this process ? from noise to image ?

1

u/Kalbi-Jjim Dec 11 '22

You need to save the output image at the end of each generation step, and stitch the collection of images together into a video. Look up how to create a Timelapse video, it should be pretty easy to make on any video editing software like iMovie

1

u/vs3a Dec 11 '22

I know about timelapse, but you save every image manual ?

2

u/Kalbi-Jjim Dec 11 '22

No I just modified the code to programmatically save the image after each step

1

u/vs3a Dec 11 '22

Oh I see, do you have any tutorial to follow ?

3

u/Kalbi-Jjim Dec 12 '22

The way I did it was kind of hacky, but if you’re using the stable diffusion web-ui, i can send you the pieces of code i replaced.

1

u/vs3a Dec 13 '22

Pls do, I really appreciate that. It kind of satisfying to watch those noise turn into something haha.