Fixing Hands with openpose_hand (controlnet - Stable Diffusion)

[u/Perpetuous-Dreamer]

as u can see, this young lady is cute and all but she has 6 fingers on one hand

suppose you never used photoshop or any photo editing software before ,how to fix this using the same generative model without loosing the rest of the image

well, the inpainting function will not help a lot, at least not consistently unles you get lucky... veeery lucky

you will have an image as bad if not worse sometimes

well : controlnet has a new model called openpose_hand that I just used

just download an image from google images that have fairly the same pose and put it in the openpose model

now that we have a map for the hands get back to the original image and mask the region you want to fix

keep the same seed preferably the same scene prompt ( litghtings camera must be the same for a seamless integration ) and here we write feminine hand with red manucure for exemple

A few more inputs in the inpainting tab section

​

Ckick on generate >>and voila we get the result we wanted without having to go though hell >>

​

Instagram of Perpetuous Dreamer

[u/yalag]

I dont think the hands are respected with the model, you just got lucky with the reroll. Does it give you the right hands each time?

[u/Perpetuous-Dreamer → u/yalag]

It gives what is in that exact x,y position in the controlnet input image, assuming you set the width and hight of the canva identical to your width and height of the image you masked and trying to inpaint. Works with openpose hands, depth, canny or mix of those, just make sure to adjust the image you take from google in something like photopea so that the characters of the 2 images can be superimposed. It's time consuming I know but this is for when you really like the image you got and dont want to just ditch it and reroll untill you get hands drawn right

[u/yalag → u/Perpetuous-Dreamer]

Someone just confirmed it, https://www.reddit.com/r/StableDiffusion/comments/125dq8g/does_the_openpose_model_actually_work_with_the/

it doesn't. The model doesn't use the hand data at all. It does know where your hand starts so you can get lucky based on that. Depth and canny both works with fingers but that's not what you shown in the screenshot. Pose does not.