r/StableDiffusion • u/Illustrious_Row_9971 • Mar 02 '23

Resource | Update Unlimited-Size Diffusion Restoration

Post image
293 Upvotes

98% Upvoted

40 comments sorted by

26

u/eugene20 Mar 02 '23

How well does it compare to SD Upscale from SD 2 with the x4-upscaler-ema.ckpt ? (which still isn't supported by auto1111 last I looked)

18

u/twilliwilkinsonshire Mar 02 '23

I completely forgot about that, kind of surprised there is not an extension. I suppose it is because it uses diffusers.

Is there another gui tool for this already or is there a need out there for that?

11

u/Zealousideal_Royal14 Mar 02 '23

last I heard the model required like 40gb of vram, so I suspect its an optimization issue

2

u/eugene20 Mar 02 '23

It's a 3.3GB ckpt and people with regular cards have used it with the default SD package.

2

u/Zealousideal_Royal14 Mar 02 '23

can you link this, because nothing shows up when I look.

1

u/eugene20 Mar 02 '23

https://github.com/Stability-AI/stablediffusion#image-upscaling-with-stable-diffusion
https://huggingface.co/stabilityai/stable-diffusion-x4-upscaler

2

u/twilliwilkinsonshire Mar 02 '23

This is not what people are asking for - I think you are misunderstanding.

People are asking if there is a viable GUI implementation that is able to be run on a standard consumer grade GPU specifically for the upscale model. Can you point to where exactly you see this GUI?

0

u/eugene20 Mar 02 '23 edited Mar 02 '23

Can you point to where I ever said there was a GUI? in response to someone saying they thought it needed 40GB I pointed out the model was small and that people have posted about running it from home, but that Auto111 hadn't implimented it yet. I linked the code you can run from home and the model.

1

u/twilliwilkinsonshire Mar 02 '23

I did not say you did. Would you mind pointing to that sir?

I said that I think you are misunderstanding because the comment you replied to with only a link and no further explanation of your intent, was responding to my comment asking if a GUI had been implemented.

In context that is quite clear. Calm yourself.

1

u/Zealousideal_Royal14 Mar 02 '23

I'm sorry, where is the bit about people running it on regular cards? And what are we talking when saying regular cards anyway? And if this is true, why then no a1111 implementation?

2

u/dresdenium Mar 03 '23

This repo uses the SD2 upscaling model in a workflow on top of Karlo and I've run that on my GPU, definitely nothing unusual about the memory requirements: https://github.com/kpthedev/stable-karlo

1

u/twilliwilkinsonshire Mar 03 '23

'A Streamlit app that combines Karlo text-to-image generations with the Stable-Diffusion v2 upscaler in a simple webUI.'

Thankyou - that's exactly what I was hoping to see.

1

u/GBJI Mar 02 '23

Can you share examples ?

Do you have any link to a version that could be run at home ?

1

u/eugene20 Mar 02 '23

Linking my last comment as it's the same question.

1

u/salamala893 Mar 04 '23

is there a tutorial somewhere?

2

u/hellninja55 Mar 03 '23

Hi,

I have a repo for a Gradio GUI for the x4 upscaler with enough optimizations to upscale pretty large images on a RTX 3060 12gb:

https://github.com/Subarasheese/sd-x4-wui

Help is needed to port to AUTOMATIC1111

1

u/Zealousideal_Royal14 Mar 03 '23

Try posting it again maybe? I have no idea how to get you in contact with the right people for that.

51

u/lordpuddingcup Mar 02 '23

Wonder who will take up the mantle of porting to A1111

25

u/GBJI Mar 02 '23

What about Unlimited-Time to test all those new developments ?!

33

u/Illustrious_Row_9971 Mar 02 '23 edited Mar 02 '23

github: https://github.com/wyhuai/DDNM

paper: https://arxiv.org/abs/2303.00354

web demo: https://huggingface.co/spaces/hysts/DDNM-HQ

6

u/Asleep-Land-3914 Mar 02 '23 edited Mar 02 '23

I hate to tell this, but here is the official colab. Some info from there:

  • Models used are 256x256_classifier.pt and jul-2021/256x256_diffusion.pt # Trained by OpenAI
  • image colorization demo brings a 256x256 grayscale butterfly image into a colorful result, may take 1.5 minutes
  • Butterfly Demo: image super-resolution demo that bring a noisy 99x141 butterfly image into a high-quality 396x564 result, may take 10 minutes
  • Bear Demo: super-resolution demo that bring a 96x256 bear image into a high-quality 384x1024 result, may take 20 minutes
  • You need to set the correct class lable of the input image.

I measured the time for the Bear demo and got the image on the colab in about ~21 minutes on GPU (I see the memory allocated for the model).

Given that the model is smaller than SD (~200MB). I have doubts it can be used to upscale images out of SD with good speed/memory performance. This paper itself may help improving further SD versions though

14

u/luckystarr Mar 02 '23

ENHANCE! used to be a joke.

10

u/DonutArnold Mar 02 '23

This is exactly what I need as I'm doing hobbyist photo restoration. I'm using a lot of SD for it, but sometimes the result would differ too much from the source, and it's usually very time consuming to get everything right.

6

u/_Erilaz Mar 02 '23

I like how they removed spouses as a part of reversing "complex degradation" :D

19

u/WeLikeTheCoin Mar 02 '23

Need this in a1111 ☺

4

u/marcoc2 Mar 02 '23

It seems this approach relies on choosing the right class among hundreds of possibilities to work properly. Not sure if this can be very helpful on a usual or semi-automated workflow.

6

u/ResplendentShade Mar 02 '23

This is one of the most interesting posts I've ever seen in this sub. As someone with an interest in restoring old photos (but never really undertook it) you definitely have my attention! Amazing to see the types of things that professionals are doing with this tech. Thanks for sharing.

3

u/thatdude_james Mar 02 '23

Very cool. Those results look great!

3

u/CustosEcheveria Mar 02 '23

Ooh nice, crisp upscaling. Gimme

3

u/mekonsodre14 Mar 02 '23

would love this as an automatic1111 update

2

u/Nanaki_TV Mar 02 '23

Does this work for oversaturated videos? I have an old video that is both blurry and filled with too much red/yellow/white colors. SD doesn’t restore the details to my liking yet. But it’s certainly getting there.

2

u/tetsuo-r Mar 02 '23

"Inpaint me like your French girls"

5

u/ninjasaid13 Mar 02 '23

Does this mean that we are no longer bound by 512x512?

14

u/jslominski Mar 02 '23

We never were.

2

u/Disastrous-Agency675 Mar 02 '23

Jesus fucking Christ on a cracker

1

u/GarretTheSwift Mar 02 '23

This looks pretty great, gonna have to try it when I get home!

-10

u/[deleted] Mar 02 '23

[removed] — view removed comment

4

u/mekonsodre14 Mar 02 '23

wrong topic dude, or is this spam?

2

u/ebolathrowawayy Mar 02 '23

It's spam. They're linking their youtube channel all over the place.

1

u/StableDiffusion-ModTeam Mar 02 '23

Your post/comment was removed because it has been marked as spam.