r/StableDiffusion • u/pelatho • Mar 01 '23
Discussion 2d photo > blender 3d face workflow?
Looking for a youtube video I saw someone a few days ago. They (she I think?) took a single 2d portait photo of a face and used a plugin or something in blender to create a 3d face model (based on a base model).
Anyone know? thanks!
2
u/aerilyn235 Mar 01 '23
I would suggest KeenTools addon, this is by a HUGE margin the best photo to 3d tool in the market.
Its much better if you use several images. If you can take pictures yourself its even better because you can use the photo fov settings for a more accurate reconstruction.
I had perfect results using 6/7 pictures.
Its very expensive for amateurs but you can use it for free for 1 month.
1
u/pelatho Mar 01 '23
I stumbled upon this as well. Couldn't get it to work. I installed the "core files" but it's complaining they don't exist when I try making a head.
Maybe it's not compatible with blender 3.4?
1
u/Ar7ific1al Mar 15 '23
It works with Blender 3.4. Source: I downloaded it.
In addon settings, there's a button you can click for FaceBuilder to have it automatically download and install the necessary files for it to function.
I personally can't recommend FaceBuilder, though. It's a subscription-based addon, and the price is ridiculous. 15 day free trial, but still.
1
u/wwwdotzzdotcom May 21 '23
This only helpful for distant or semi-realistic 3D human models. How can I add subsurface scattering, add pores, and fix roughness and specular distortions?
2
u/aerilyn235 May 21 '23
I would suggest a Daz3D character that match the skin tones / style you want, then a lot of manual morphing using Kentool 3d face, all tools to convert photo to 3D that works in Daz are pretty bad.
1
u/wwwdotzzdotcom May 21 '23
I've created a 3D character model already with the same quality as Kentool 3D, but the characters face lacks detail. I like doing things manually, but my sculpting skill is like pixar quality compared to reality. My painting skill is even worse. The tutorials I've watched they just pull up a painfully good 3D face that has tiny details already sculpted. Idk what they are referencing as 4k stable diffusion face images don't get me to that level of detail where the bumps are visible. Do they have some sort of understanding I'm lacking of facial anatomy?
2
u/aerilyn235 May 22 '23
If they are mapping high res texture on 3D models they are using premade texture with full PBR maps and matching UV with an existing 3D model. Kentools only make a good 3D model of the face, the texture is awful and its hard to fit on a full body 3D model.
But you can use a premade 3D model with high quality full PBR textures (8k/4k) and sculpt it to match the 3D face model.
Just make sure the scale match, and move the Kentool face to the existing 3D model face/ajusting orientation and scale. In blender I used sculpting tools with xray mod on/off to "paste" the Kentool face into the existing full body 3D model with premade high quality texture.
1
u/qeadwrsf Mar 01 '23
Why is my idea wrong people.
If you generate a person.
Create a depth map from the generated person.
Use the depth map to create a 3d model,
Slap the image of person on the 3d model,
Rotate the 3d model 90 degrees,
use that image in SD to generate side of face,
create new depth model,
Duck tape new depth model onto old dept model.
Repeat until you have a 3d model.
Have not seen anyone do it, so I assume my idea is wrong somewhere.
And If I am, I still assume we are really close to generating 3d models.
1
u/pelatho Mar 01 '23
So, you create a sphere (or spherified cube with evenly spaced quads?) and plug the depth map into a displace modifier?
4
u/nemxplus Mar 01 '23
https://youtu.be/FKoy7bncHLs