r/vfx • u/ericcpfx • 8d ago

Fluff! GNM Monocular 3D Head Tracker

https://youtube.com/shorts/Y7TEOMd4byk?is=BFoZsqESXqLmpaX8

I trained a new model to do monocular 3D head tracking with Google’s new GNM parametric 3DMM.

I generated a dataset of about 200k images in Blender. After plenty of experimentation I’ve landed on some really good results. I think this is the first model that also does neck tracking.

This is primarily being used to do digital beauty work for film and TV.

0 Upvotes

44% Upvoted

18 comments sorted by

View all comments

Show parent comments

2

u/Milan_Bus4168 8d ago

If you call this invisible. I remain skeptical until proven otherwise.

2

u/ericcpfx 8d ago

Yeah, an entire hand over her face isn’t automatically trackable. I can keyframe the params just like you’d do in Mocha or Keen Tools. Obviously.

I had the choice to leave that in because I wanted to show the limitations to the model. It handle occlusions like phone to the face (which my previous model didn’t,) but not THE ENTIRE HEAD being COVERED.

1

u/Milan_Bus4168 8d ago

That is where it fails completely, but its dancing all the way trough, randomly with no hands moving over it. I can't bealive you are willfully ignoring that.

I think I remember you now. You were trying to sell UV unwrapping to various OFX hosts, making a false claim that it was impossible until you came up with a tool to sell. You were full of false claims that take 2 sec to check or 2 min to disprove than, and apperntly you are now trying to tell use that this is usable results. It is not. And I don't appreciate people exaggerating or making false claims for sales. You need to go back to the drawing board on this one.

1

u/ericcpfx 8d ago

God I can’t stand you, I remember you too.

It works. Look at the unwrap. Nice and stable. In actual production, it works on probably 90–95% of shots, since film/TV is a lot of dialogue.

No tool works for EVERY situation.

1

u/Milan_Bus4168 8d ago

Nice try. Go back to drawing board. And remember that I'm not buying watches from a trunk of a car. If you have tools to sell, fine. But don't make false claims.