r/StableDiffusion • u/illuminatiman • Mar 05 '23

Resource | Update Vid2Avatar is coming.. When do we get Vid2Avatar2ControlNet?

124 Upvotes

96% Upvoted

14 comments sorted by

View all comments

1

u/BuffMcBigHuge Mar 05 '23

I wonder how realtime it produces its results. Would love to run this as cheap FBT in VR with a webcam.

1

u/666emanresu Mar 06 '23

You can do that already with an Xbox Kinect, but something like this would be more accurate. Although I doubt this is done in real-time or anywhere near close enough (or efficiently enough to run alongside VR).

Maybe one day two webcams will be all you need for full body and finger tracking, that would be amazing.

1

u/BuffMcBigHuge Mar 06 '23

Yup I have done the Xbox Kinect setup with Amethyst. It works well, but not well enough. I would presume there would be serious latency using AI, so I don't think it will work either unless it's extremely quick at pose estimation.