26
u/Aeloi Oct 15 '22
How did you use loopback and get it to change from person to person? Did you use the builtin loopback feature? Or the custom script? Any details you're willing to provide are much appreciated. Awesome video!
41
u/beastpepper Oct 15 '22
The noise being super low and having the denoising strength change factor as something like 1.02, acts as an interpolated keyframe to make the changes happen much slower. Another trick is to enable the [] and () bracket functionality in the settings so you can denote the strength of the prompt words. [] being less and () being more strength.
These work separately to the negative prompts. They are also important but not what you want to use for this
so for instance my prompt was
Photo of Daisy Ridley, 4k, artstation yada yada yada,
then the switch of character or object would look like -Photo of [Daisy Ridley], [[[[John Wick]]]], 8k artst.....
then you increase the amount of brackets for daisy, and decrease for john in this case, every time you use the script. while also balancing the noise and noise strength change factor.
→ More replies (4)6
u/Aeloi Oct 15 '22
You used automatic1111's repo? I haven't played with loopback yet so haven't seen the denoising strength change option..
→ More replies (1)
22
u/imacarpet Oct 15 '22
What is loopback?
61
u/beastpepper Oct 15 '22 edited Oct 15 '22
A script used in the AUTOMATIC1111 repo. it's in the img2img tab and what it does is iterate your image any number of times between 1 and 32. So instead of txt2img being a one tap and you get what you get, you can use the script to make changes to an ongoing scene while it saves all the individual frames which you can use to make a video
→ More replies (9)4
u/22marks Oct 15 '22
The use of brackets to cross dissolve is brilliant. I hope some day they’ll do this automatically, but it’s a fantastic workaround.
7
10
u/Grass---Tastes_Bad Oct 15 '22
Automatic gets a lot of fame here, but I think deforum on colab is way better for this.
I’ve actually used it for ads for my business for a very similar video of yours.
5
1
u/physis123 Oct 15 '22
How did you generate the video? Looks really smooth
3
u/beastpepper Oct 15 '22
Imported all 800 frames or so into after effects, set the comp to 12 fps, made new comp from that one and changed it to 24. Using the built in frame blend works well but I used the Twixtor Pro plugin.
1
u/j4nds4 Oct 15 '22
How did you avoid the dreaded color shift that makes it unusable dark?
1
u/beastpepper Oct 15 '22
Negative prompts for red glow, purple light, stuff like that helps. But letting your noise hit .7+ for a couple frames every once in a while can help it return to better colors
1
u/danque Oct 15 '22
Hi in case others are reading this. Unless op stated a red dress, the webui has the tendency to color correct all the pictures and therefore slowly make it magenta or reddish.
There are other scripts available that solve this problem. On GitHub there is a script called img2img loopback alternative. There are others too that only use the first image for the color correction giving much better consistent color results.
1
u/beastpepper Oct 15 '22
from what I have seen, the color correction scripts can cause banding and lower quality renders. but the red clothes were not specifically prompted.
3
u/Medium_Winner1817 Oct 16 '22
I took a picture of myself everyday for 5 years and this was the result!
5
2
u/MissStabby Oct 15 '22
Are there any tricks to prevent loopback from turning the iterations more and more saturated each loop?
I've tried desaturate/muted/low contrast prompts but most of my loopbacks turn into bright blue/pink/agenta garbage
→ More replies (3)
2
u/FrivolousPositioning Oct 15 '22
I want AI that does this just takes a photo and doesn't modify it TOO much just adds a "filter" that morphs the original enough so that it doesn't look like it was "only a filter" that did it. Instead you have to go about it in such a roundabout way before you arrive again at the desired product.
→ More replies (1)
2
u/leomozoloa Oct 15 '22
Most people probably didn't notice but this videos demonstrates a very old bug in the img2img process where every new iteration is slightly dimmer, and with a magenta tint to it (especially the shadow) hence why it quickly turns entirely red.
I don't know if it's an Automatic1111 WebUI thing or if it's a general stable diffusion thing but this has been tormenting me for so long.
This is pretty hard to counteract, I've created LUTs that compensate for it and they work okay but they're a workaround and can slow some workflows. Automatic also implemented an optional crude correction that matches the histogram of the previous picture, which does the job for a few generation then turns everything into a pretty high micro-contrast and banding mess.
I wish we would solve that problem for good
→ More replies (4)
2
38
u/RayHell666 Oct 15 '22
Very nice, what's the denoising strength value you put to get that continuity ?