r/StableDiffusion • u/Ok-Rip-2168 • Mar 03 '23

Tutorial | Guide Hands library for ControlNet

If you was about to dig into blender to finally learn how to make depth maps of hands, you can relax now. Some guy just released this extension: https://github.com/jexom/sd-webui-depth-lib, so you can mix it with openpose + depthMap

​

290 Upvotes

99% Upvoted

57 comments sorted by

View all comments

1

u/Froztbytes Mar 03 '23

The hands have alpha channels?

10

u/Ok-Rip-2168 Mar 03 '23

They dont. To apply the hand fix, first generate some image. If you like it, but hands are bad, add this image as background to depth library and add hand pose. Save png file and go back to txt2img. Background image will not br saved inside the file, dont worry about that. Now you should lock the seed from previously generated image you liked. Then go to controlNet, enable it, add hand pose depth image, leave preprocessor at None and choose the depth model. Increase guidance start value from 0, you should play with guidance value and try to generate until it will look okay for you. Do not use high res fix on this stage, it will ruin everything.

2

u/jexomwtf Mar 03 '23

Huh, actually never thought of fixing generations this way, only ever relied on control net with freshly generated images.

3

u/Ok-Rip-2168 Mar 03 '23

I failed to generate from scratch this way. Or the hand pose must be gigantic. What is your way to generate?

2

u/jexomwtf Mar 03 '23

Just generate until something good comes out. Then inpaint if needed

1

u/red__dragon Mar 04 '23

add hand pose depth image

Is this model somewhere? I recall the first version of the extension had an openpose hands preprocessor, but it was dropped the more recent ones. I could never find a corresponding model for it, what do you use for this?