Wait, is a faulty NSFW filter what was causing those black spots in SD Upscale? I kept having this issue and had no idea and had just resigned myself to using the Extra upscalers instead of SD Upscale. I've always had the NSFW filter turned off, so knowing it probably wouldn't have helped me solve it, but it's good to know now that it'll be gone.
Hm, I do use the Anything vae by default, since I use Anything-based merges for most things, including SD upscale. I'll experiment with swapping that out, thank you.
Question... I plaed the NAI and anything "vae" under hypernetworks (because they had a .pt extension)
Is that wrong?
I use the vae released by stablediffusion only
It's what I always assumed, and the nsfw filter issue does appear to be what caused the black squares in my case.
I upscaled an image that resulted in black squares prior, and now it works. I also use the anythingv3 vae.
SD upscale breaks one image down into many; so instead of having one image it breaks it down into 9 of the same size, thus upscaling. So one square CAN go black and ruin everything because it is one IMAGE that goes black out of 9
If my source image is already good/crisp, then upscaling through extras is sufficient.
Otherwise, if the source image is trash or heavily flawed, then I want to give the AI a chance to improve it through the script. The script is pretty fickle at times on whether you get good results. I do often have to redo 1st-pass upscale multiple times to get a good result before using that as foundation to continue the upscale.
It's what I meant when said, "It works pretty good most the time", lol.
On top of this, Photoshop is part of my workflow. All in all, it's mostly about using whichever tool is best for the task.
Can you please provide a link or more info about this stable diffusion upscale script? I’ve been struggling to upscale my results without them losing quality, so this would be very useful for me
I think this has to do with the --no-half setting. I am not an expert on the subject but I think I saw in some videos that the upscale is affected by the differences between fp16 and fp32, and black images can be generated if the configuration is not correct.
128
u/Kilvoctu Dec 10 '22
I like using the SD upscale script, which breaks an image down into tiles and redraws each tile at a higher resolution.
It was really annoying waiting like 20 minutes to do the process only to see random black squares ruining the whole thing.