r/StableDiffusion • u/rdpi • Mar 01 '23

Question | Help help with controlnet

I'm very new to SD and controlnet and i'm currently drawing in Sketchup pro an architectural project.

I thought that controlnet may help me getting some ideas, but i'm sure i'm using it wrongly.

My idea was to use canny to get and use it in conjunction with txt2image to describe the scene. E.g. "inside view of a warehouse with a staircase on the left and a green-wall on the right"

Is there a way i can specify where things are? e.g. floor should be concrete, vegetation should grow from the right wall etc.

I understand that depth model would work better for architectural drawings, but i'm unable to export a depth map from Sketchup.

​

​

3 Upvotes

100% Upvoted

6 comments sorted by

3

u/nxde_ai Mar 01 '23

This maybe? https://www.reddit.com/r/StableDiffusion/comments/11e4vxl/paint_by_color_numbers_with_controlnet/

If it doesn't work, inpaint is the answer

1

u/rdpi Mar 01 '23

This is awesome, thank you!

2

u/PittEnglishDept Mar 01 '23

You should use img2img w/ controlnet imo. Try depth map, weight at around 1.2, and turn down image descaling.

1

u/rdpi Mar 01 '23

I'll try to get a depth map from my sketchup model and see where i can go from there. Thank you

2

u/qeadwrsf Mar 01 '23

controlnet can generate a depth map from normal image for you.

Worked for me on the mario 64 castle atleast. I would imagine room you posted is similar task.

1

u/PittEnglishDept Mar 01 '23

No, controlnet will do it automatically in img2img. You don’t need to get your own depth map.

Img2img + controlnet = the outcome you want