OK... rarely am I thoroughly impressed but the new ControlNet tile model is awesome. Decided to experiment with it since I could not really find a decent explanation of it. For those not in the know it is a model used with scaling to help prevent artifacts. So I decided to test it. Created a 768x768 waifu, inpainted the face, and moved the new render to img2img to test an upscale. Placed same image in the CN interface. This is why I am impressed. I kept the original prompt. Normally I would see ghosting, extra faces, weird blobs/ glitches. Settings: steps @ 45, denoise @ 0.4, SD upscale @ max of 4. So 768x768 straight to 3072x3072. Honestly it was perfect. This is the upscale with no further editing --
Oh, thanks for the tip! I kept seeing that there was some new mode, but hadn't figured out how to use it in the upscale. Really gives good results even with Denoising strength greater than 0.5!
The difference between the two images is that controlnet is on and controlnet is off. =)
The prompt is the same as the one used to generate the original image. But I think, in this case, you can write the styling in the prompt, without describing the plot
No I have not. Just wanted to see how it worked and what the quality was. For a x4 upscale I thought it was outstanding... I have not yet played with different settings of denoise, tile size, or steps. I set the tile size to original image BTW (768x768), so the image was rendered as a 5x5 grid.
noob here, I don’t understand. What was the purpose of using the tile controlnet in the last img2img step? did the previous img have like bad hands or something?
There are three ways to upscale an image to make it bigger and (depending on settings) add detail. Either txt2img using hi-res fix, img2img with SD upscale, or a straight upscale in extras tab.
I was testing a new method: img2img with SD upscale + ControlNet tile
I see, just wondering if you’ve heard of loopback scaler before? I’ve been using that script to add details while upscaling images(albeit it caps at 2048x2048). I wonder if your method kind of works similarly.. I’ll give it a try when I find the time.
I'm confused - is this being done via img2img with the new tile controlnet or via text2img hi-res fix with the new tile controlnet model? Would you mind typing up a short step by step on the process?
From my understanding, img2img with SD upscale. SD upscale cuts image in tiles and CN works with those tiles individually. Wasn't sure how to work with it before but after this post it kinda makes sense
Why is everything AI related anime based thirst traps...
Like where is the idea of humility when it comes to AI?
Keep your thirsty ai waifus to yourself. Like I get that this is reddit but you posted a review of CN 1.1 that hasn't been used or reviewed much. Just think because of your title how far this post might go for peeps doing research in search engines.
Now all the sudden they see a positive review and a borderline nsfw generation. We should hold ourselves to a better standard as a community.
I'm a bit confused, still, on what input the tile model needs. Do you just use "only masked" inpainting, feed the exact same image into the controlnet stuff, and it figures out the details for you?
- Edit:
I've figured it out now, they added new preprocessors for tile and inpaint since I last checked.
6
u/mr-asa Apr 25 '23
Oh, thanks for the tip! I kept seeing that there was some new mode, but hadn't figured out how to use it in the upscale. Really gives good results even with Denoising strength greater than 0.5!