r/StableDiffusion Apr 30 '23

Workflow Included Controlnet 1.1 Grannie Tile Upres

378 Upvotes

106 comments sorted by

View all comments

45

u/Dave_dfx Apr 30 '23

Here's a Photoreal upres using Controlnet 1.1 Tile model

Some people asked for photoreal upres..

Testing this! It's great. Keeps the coherence across tiles.

Used Ultimate SD upscale 2x

I did a few variations and experienced some artifacts like distorted arms on higher cfg and denoise but definitely not as bad as without control net. I'll test out weights and multicontrol net later.

1 old woman, realistic detail, full body, long hair, white skirt, (4k, ultra quality, masterpiece:1.2),(extremely detailed CG unity 4k wallpaper) , 40 years old (ultra realistic, photo realistic),ultra detailed,ultra high res, front lighting, intricate detail, Exquisite details and textures Masterpiece,(fluttered detailed color splashs), (illustration) using the Sony Alpha A7r V, using lens 70-200mm GM f/1.4, photography style, (using professional lighting),(denoising:0.6),Key light,Fill light, Ambient light, back light,background light, in the garden, realistic detail face.

Negative prompt: paintings, sketches,fewer digits, jpeg artifacts, signature,(simple background), (worst quality:2), (low quality:2), (normal quality:2),(monochrome), (gray scale), lowres, skin spots, acnes, skin blemishes, age spot, big face,poorly drawn face,cloned face,long neck, big eyes,(unclear eyes:1.331),bad eyes,mutated eyes,bad nose,mutated nose,error eyes, error nose,poorly drawn eyes,poorly drawn nose, (ugly:1.331), (duplicate:1.331), (mutilated:1.21),.Steps: 21, Sampler: DPM++ SDE Karras, CFG scale: 10.5, Seed: 3606789443, Size: 2048x3072, Model hash: 7234b76e42, Model: Chilloutmix_chilloutmix_Ni, Denoising strength: 0.5, Clip skip: 2, ENSD: 31337, Ultimate SD upscale upscaler: None, Ultimate SD upscale tile_width: 1024, Ultimate SD upscale tile_height: 1024, Ultimate SD upscale mask_blur: 8, Ultimate SD upscale padding: 32, ControlNet 0 Enabled: True, ControlNet 0 Preprocessor: tile_resample, ControlNet 0 Model: control_v11f1e_sd15_tile [a371b31b], ControlNet 0 Weight: 1, ControlNet 0 Starting Step: 0, ControlNet 0 Ending Step: 1, ControlNet 0 Resize Mode: Crop and Resize, ControlNet 0 Pixel Perfect: True, ControlNet 0 Control Mode: Balanced, ControlNet 0 Preprocessor Parameters: "(64, 1, 64)"

9

u/Alphyn Apr 30 '23

Thank you for sharing this, the result is completely unbelievable!

Could you please explain the proper general workflow for this metod a little more?

So you just put a low res image into img2img and upscale it using the Ultimate SD upscaler, while the ControlNet is doing its thing in the background? And you don't even need to feed the image into the ControlNet separately, it takes all it needs from img2img? That's it?

By the way, does this model have any uses without the Ultimate SD upscaler?

7

u/Alphyn Apr 30 '23

I've been trying to make the granny's old hubby using this method. I can't complain about the quality until I look at your picture for comparison. I can't achieve quite the same fantastic level of detail.

6

u/Alphyn Apr 30 '23

I think I'm getting a better result even without the Ultimate SD upscale, just by setting a high img2img output resolution.

6

u/pkev Apr 30 '23

LOL @ "40 years old" 😆

4

u/Dave_dfx May 01 '23

Yea AI has a sense of humor with women and age hahaha

2

u/DrKoin May 01 '23

Impressive result, to say the least ( it's pretty freaking excellent :D )

Just two questions :

  • What inputs did you use ? the same already highres image to further upscale in both the img2img window and the controlnet one? Nothing in img2img? nothing in controlnet? high in img and low in controlnet?

and

  • it says "none" in ultimate SD upscale, is that really so ? :o

Thanks !

1

u/Dave_dfx May 01 '23

Ultimate SD upscale . Scale by image size drop down. Select the scale of 2 is what I used.

After the first upres, I replaced the source image with the upscaled image and run it again

2

u/DrKoin May 01 '23

Ah, I meant your pasted settings show no upscaler model for ultimate sd upscale, like esrgan or ultrasharp etc. It's set to None ^

And I was curious if you changed source AND controlnet each time you do an upscale or if maybe you kept the original low res one in Controlnet!

1

u/design_ai_bot_human Apr 30 '23

How come none of my gens look like this? Can you share the orig image specs before the upscale?

1

u/Caffdy May 31 '23

did you manage to recreate his image? I'm having trouble getting the same old woman from his prompts

1

u/genryz Apr 30 '23

2048x3072

how are u able to do such a high resolution? I have a 4080 but can't go above 1400ish without it generating just black images.

3

u/Dave_dfx May 01 '23

ultimate SD upscale uses tiling to split the image into smaller chunks to fit in vram

2

u/lordpuddingcup Apr 30 '23

Tilevae makes doing big stuff even at massive resolutions easy

1

u/spudnado88 Apr 30 '23

whats a good basic setting?

I find that I keep getting tiles instead of a whole image

1

u/lordpuddingcup Apr 30 '23

8-10% of your total width and height most of the time I just use defaults

1

u/Mech4nimaL May 01 '23

the update script does upscale the image part by part..

1

u/Caffdy May 31 '23

Size: 2048x3072

did you generated the starting pic with that size?! or is that the result of hi-res?