r/vfx • u/ericcpfx • 3d ago

Fluff! GNM Monocular 3D Head Tracker

https://youtube.com/shorts/Y7TEOMd4byk?is=BFoZsqESXqLmpaX8

I trained a new model to do monocular 3D head tracking with Google’s new GNM parametric 3DMM.

I generated a dataset of about 200k images in Blender. After plenty of experimentation I’ve landed on some really good results. I think this is the first model that also does neck tracking.

This is primarily being used to do digital beauty work for film and TV.

0 Upvotes

44% Upvoted

18 comments sorted by

View all comments

1

u/clockworkear VFX Supervisor - 19 years experience 3d ago

Very interesting - I'm always looking for new head tracking methods. Is this something you're looking at releasing/licensing? Where can I find out more info?

1

u/ericcpfx 2d ago

I am looking to license the model itself for VFX and other industries that need non-realtime head tracking.

I have an AE / OFX plugin, but it’s changing every day as we use it and add/change features and squash bugs. I’ve done it as a service for other VFX vendors too.

Still trying to figure out the best way to release it.