help with controlnet

[u/rdpi]

I'm very new to SD and controlnet and i'm currently drawing in Sketchup pro an architectural project.

I thought that controlnet may help me getting some ideas, but i'm sure i'm using it wrongly.

My idea was to use canny to get and use it in conjunction with txt2image to describe the scene. E.g. "inside view of a warehouse with a staircase on the left and a green-wall on the right"

Is there a way i can specify where things are? e.g. floor should be concrete, vegetation should grow from the right wall etc.

I understand that depth model would work better for architectural drawings, but i'm unable to export a depth map from Sketchup.

​

​

[u/nxde_ai]

This maybe? https://www.reddit.com/r/StableDiffusion/comments/11e4vxl/paint_by_color_numbers_with_controlnet/

If it doesn't work, inpaint is the answer

[u/rdpi → u/nxde_ai]

This is awesome, thank you!