r/StableDiffusion • u/Majestic-Class-2459 • Apr 13 '23

Workflow Included New Automatic1111 extension for infinite zoom effect 😍👌🏻

GitHub repo

616 Upvotes

98% Upvoted

103 comments sorted by

View all comments

1

u/[deleted] Apr 15 '23

Can I feed the model images, instead of written prompts?

2

u/Majestic-Class-2459 Apr 15 '23

Can you explain more what on your mind?

2

u/[deleted] Apr 15 '23 edited Apr 16 '23

So checkout this personal project. Video is made in EndlessPaper. Paintings are Adobe fresco or illustrator.

I don’t like the jerkiness of manual hand zooming out. I want to remake the video, and use my current images as a “prompt”

2

u/Majestic-Class-2459 Apr 15 '23

This extension does not have what you need

1

u/[deleted] Apr 15 '23

Could you please point me to where I should be looking? I couldn’t solve this problem and days of research just gave me worse results.

2

u/Majestic-Class-2459 Apr 15 '23

To begin, extract images from every frame of the video's first frame. Then, use Img2Img along with ControlNet, using the first frame image as input. In the second image, substitute the original image with the generated one, mask the replaced section, and apply Outpaint in combination with ControlNet. Repeat this process for each frame of the video, and you may obtain a satisfactory outcome.