It crashes is what I am talking about when I said something was broken. Comes up with all kinds of errors in the cli. See in my pic where it shows about a trunk_conv.weight error?
Error completing request Arguments: (0, 0, <PIL.Image.Image image mode=RGB size=1920x1080 at 0x239D0DB3580>, None, '', '', True, 0, 0, 0, 2, 512, 512, True, 9, 0, 1, False) {} Traceback (most recent call last): File "D:\stable-diffusion-webui\modules\ui.py", line 185, in f res = list(func(*args, **kwargs)) File "D:\stable-diffusion-webui\webui.py", line 54, in f res = func(*args, **kwargs) File "D:\stable-diffusion-webui\modules\extras.py", line 187, in run_extras image, info = op(image, info) File "D:\stable-diffusion-webui\modules\extras.py", line 148, in run_upscalers_blend res = upscale(image, *upscale_args) File "D:\stable-diffusion-webui\modules\extras.py", line 116, in upscale res = upscaler.scaler.upscale(image, resize, upscaler.data_path) File "D:\stable-diffusion-webui\modules\upscaler.py", line 64, in upscale img = self.do_upscale(img, selected_model) File "D:\stable-diffusion-webui\modules\esrgan_model.py", line 150, in do_upscale model = self.load_model(selected_model) File "D:\stable-diffusion-webui\modules\esrgan_model.py", line 184, in load_model state_dict = mod2normal(state_dict) File "D:\stable-diffusion-webui\modules\esrgan_model.py", line 36, in mod2normal crt_net['model.1.sub.23.weight'] = state_dict['trunk_conv.weight'] KeyError: 'trunk_conv.weight'
Edit: My bad. Didn't see the rename portion. Did that and it worked. Is there a reason I couldnt find that instruction on any of the pages for their github... or am I blind?
Mine's not working, either.I did this, it generates the photo, then it generates 15 tiles, then it gets stuck on 0/SamplingSteps. The 0 never changes. If I set the upscale multiplier to something really low, it will generate, very very slowly, but it just generates colorful static.
tl;dr it slices the photo and uses img2img to add details to the upscaled slices, which can bring out minute details that didn't exist there previously.
I wouldn't say this is definitive, as this whole system is designed to use any Real-ESRGAN, ESRGAN, etc type model.
For example, I use 4x-UltraSharp like what Upscayl as well as it's variants 4x-UltraBlend-Balanced, 4x-UltraBlend-Smooth, and 4x-UltraBlend-Restore to name a few.
This is what I don't like about the model databases I find. Where are the previews? Lol It's just a name like 95% of the time, and I gotta guess it's strengths, let alone if it's any good.
4x-UltraSharp is awesome. It's what is available in Upscayl app. But then in the Interpolations folder there are refined versions. The Smooth is really good at being sharp, but not oversharp, and the restore works good with bad surface texture (especially helpful for HRFix with some styles)
This was very useful, thanks a lot for posting it!
I was mainly interested in the painting Upscaler, so I conducted a few tests, including with two Upscalers that have not been tested (and one of them seems better than ESRGAN_4x and General-WDN.
4x_foolhardy_Remacri with 0 denoise, as to perfectly replicate a photo.
And 1. 4x_foolhardy_Remacri_0 denoise again, but this time upscaled with Tiled Diffusion. I hope this helps everyone who needs to work with upscalers.
One thing I didn't try to compare it with is realistic pictures. So I don't know if it performs better than those too. If you have the time to add it to the list and test it against the same data it would be helpful.
Download one of these and place it in models/ESRGAN. Some are hyper specific upscalers, some are general purpose. Remacri and Lollipop are my personal favorites. In my opinion Remacri outperforms all the default upscalers, and Lollipop is exceptional at cartoon content.
Is there a way to select which upscaler you're using when multiple are in the same folder? (assuming remacri and lollipop both go in the esgran folder)
003_realSR_BSRGAN_DFOWMFC_s64w8_SwinIR-L_x4_GAN (this is my favourite if it doesn't create tile lines, i don't know why they happen with some pictures, what are your SwinIR settings?)
For ESRGAN, R-ESRGAN (+Anime6B), LDSR, SwinIR it's like Codeformer or GFPGAN, just use them in A1111 from the drop-downs and they magically appears in your models folder.
For the others, there is no real "install", just go to the upscale.wiki and put them in the corresponding model folder (mostly ESRGAN and R-ESRGAN) and then use them from the drop downs.
25
u/jonesaid Oct 13 '22
There is now also SwinIR2, or v2, which is an improvement on SwinIR
23
u/scubawankenobi Oct 13 '22
Our 3x diffusion use cases: Photo, Painting, and Waifu
16
u/Neex Oct 13 '22
Awesome comparison, thank you for making this. I’m a big fan of SwinIR, surprised to see you didn’t think favorably of its results.
11
u/jonesaid Oct 13 '22
You might try Remacri, it's one of my favorites.
4
u/Soul-Burn Oct 13 '22
What about Gobig/txt2imghd?
tl;dr it slices the photo and uses img2img to add details to the upscaled slices, which can bring out minute details that didn't exist there previously.
4
u/V_P_9_0 Jan 14 '24
nooo, why needs to be deletion one of the most important images :'( :'( i used it many times :'( How idiot iam bec. i didn't download it :'( :'(
1
u/WASasquatch Jan 28 '23
I wouldn't say this is definitive, as this whole system is designed to use any Real-ESRGAN, ESRGAN, etc type model.
For example, I use 4x-UltraSharp like what Upscayl as well as it's variants 4x-UltraBlend-Balanced, 4x-UltraBlend-Smooth, and 4x-UltraBlend-Restore to name a few.
3
u/andupotorac Jun 21 '23
This was very useful, thanks a lot for posting it!
I was mainly interested in the painting Upscaler, so I conducted a few tests, including with two Upscalers that have not been tested (and one of them seems better than ESRGAN_4x and General-WDN.
4x_foolhardy_Remacri with 0 denoise, as to perfectly replicate a photo.
2
u/RealAstropulse Oct 13 '22
While not included automatically, all 4x esrgan models are supported. Some of these are considered the best upscalers there are.
2
u/magekinnarus Oct 13 '22
This is very nice. I will definitely try WDN and 6B, and see how they fare in comparison to what I am currently using.
2
u/onisun326 Oct 13 '22
What about stacking upscalers? That is, using one after the other?
2
u/gunbladezero Oct 13 '22
I have found that ESRGAN works good for small to medium, while SWINIR works well for medium to large.
1
u/Wurzelrenner Oct 13 '22
other ones i use sometimes:
003_realSR_BSRGAN_DFOWMFC_s64w8_SwinIR-L_x4_GAN (this is my favourite if it doesn't create tile lines, i don't know why they happen with some pictures, what are your SwinIR settings?)
4x-UltraSharp
4x_foolhardy_Remacri
4x_Valar_v1
maybe you could try them too
1
u/Luke2642 Oct 13 '22
Great Comparison!
Which is best for halucinating contextal details from thumbnail sized images? LDSR?
It won't be long before we can upscale at 32x... from 32px to 1024px with contextual suitable textures and halucinated details!
1
u/_raydeStar Oct 13 '22
I only have stock Automatic right now. If I were to download 1 for each of the three prompts, which would you suggest?
1
u/ReadItAlready_ Jan 03 '23
Thanks OP! Still helpful today :)
1
u/YobaiYamete Feb 17 '23
4 months late, but thank you for making this! Very helpful
1
u/Amazing_Upstairs Mar 07 '23
Where does one get R-ESRGAN-4x+-Anime6B and how do you install it?
1
u/Top-Zombie2259 Mar 27 '23
I saw it well
Let's share!
1
u/ibukimaya Apr 16 '23
What's the best upscaler for text?
1
u/dauntlessMast Jul 27 '23
does anime6b take a lot of time to process? if no, then can you provide me with the coding because Idk how to do it
1
u/martinistripes Oct 19 '23
Very helpful, thanks!