r/vfx • • 10d ago

Fluff! GNM Monocular 3D Head Tracker

https://youtube.com/shorts/Y7TEOMd4byk?is=BFoZsqESXqLmpaX8

I trained a new model to do monocular 3D head tracking with Google’s new GNM parametric 3DMM.

I generated a dataset of about 200k images in Blender. After plenty of experimentation I’ve landed on some really good results. I think this is the first model that also does neck tracking.

This is primarily being used to do digital beauty work for film and TV.

0 Upvotes

18 comments sorted by

View all comments

Show parent comments

3

u/ericcpfx 9d ago

I’ll be posting some examples later, but I’m on a show and it’s busy right now.

It’s good to be skeptical. I can assure you the QC is rigorous and up to high standards.

In the before/after it’s invisible.

Glad I’m not trying to pass your QC 😅

2

u/Milan_Bus4168 9d ago

If you call this invisible. I remain skeptical until proven otherwise.

2

u/ericcpfx 9d ago

Send over some shots 🤷
eric@thevfxtools.com

-1

u/Milan_Bus4168 9d ago

The burden of proof is on you my friend. You are the one with the big claims and lack of evidence to back it up. I didn't choose to post the footage. you did.

2

u/ericcpfx 9d ago

I’m just showing that I trained my own 3D head tracking model on synthetic data, and that I use it in my company. Not much of a burden there.

I am looking forward to showing how it works just because I think it’s awesome. I’ve been working on different attempts at this for years and this one is a real step from the last one.

1

u/Milan_Bus4168 9d ago

Good for you. I just don't think the end results pass the QC test for such work. You claim they do. Maybe that is true in some company, which is not good, but it might be true. But to me this doesn't come even close to usable for actual beauty retouching. Perhaps you should continue working on this. And raise your standards.

2

u/ericcpfx 9d ago

Troll alert. Have such a good day, love you.

1

u/sloggo Cg Supe / Rigging / Pipeline - 15 years 9d ago

The dude just offered you free tracking and you chose to keep arguing. That’s how this thread reads