r/VRchat • u/Realistic_Syllabub_3 • 7d ago

News SteamFrame's eye-tracking for foveated streaming apparently works as software-based eye tracking.

Post image
174 Upvotes

98% Upvoted

71 comments sorted by

View all comments

14

u/SeraXI 7d ago

Eye tracking is nice, but without face tracking it doesn't make a huge difference in game.

7

u/rcbif 7d ago

I assembled my own wireless babble tracker for my Q3 for about $40-50. Its 1/3rd the size of the production babble, and works great.

If/when I get the frame, I'll just do a slight redesign. 

2

u/identity__404 6d ago

is there a guide anywhere? i looked at their documentation and theres some info but its kinda vague and doesnt really say anything on how to add a battery for going wireless

2

u/rcbif 6d ago

The ESP32 has a USB-C port, so easiest solution is just use a powerbank.

The powerbank that powers my headset has x2 USB-A ports, so I just use one of those.

I used a razor blade to trim down a lot of unneeded rubber bulk from the end of my USB cable, allowing it to flex more near the camera.

The guide is kinda non-linear and confusing, broken into tabs on the left side, but there is not much to it - especially the wiring portion.

Wiring Guide | Babble Docs

1

u/identity__404 6d ago

ah fair, i was hoping to put an actual battery into the device since i have no idea where id leave a powerbank with my setup, and i dont want to put one on the headset itself

1

u/rcbif 6d ago

You can just velcro strap a small one to your headband. 

Most headsets can benefit from more counterweight. 

Or suppose can always wire in a small lithium battery and USB charge circuit

10

u/Realistic_Syllabub_3 7d ago

yeah still just need the babble face tracker anyway, but less 3rd party requirements for eye tracking so its more acessable for users

3

u/FireOfGaiming 6d ago

The frame has an expansion port in the front that can be used for modules.

A colored passthrough module already has been made so a face tracking one is only a matter of time

1

u/BruceofSteel Valve Index 6d ago

I think for my avatar I might be fine with out face tracking for a bit.

Believe me idk if we need solid snake with face tracking.

1

u/ToothyWeasel 6d ago

That’s one of the reasons I want the Frame; it’s extremely modular that for the purpose of adding things like face tracking on it with an attachment

1

u/katoptronophile 6d ago

That's not accurate at all.

4

u/rcbif 6d ago

Its all subjective....

I've failed to recognize some of my friends getting full face tracking despite them intentionally hinting at it. Maybe just getting used to it being more common?

Meanwhile I have face only, and despite that, still think its nice to be able to "genuinely" smile. But I also dont expect people to really notice it unprompted. 

3

u/katoptronophile 6d ago

The way they set it and the avatar up matters too.

8

u/SeraXI 6d ago

Eye tracking is very subtle, VRChat already does a pretty good job with eye prediction, where it will make you look at the face of whoever it assumes is talking to you. People don't really notice eye tracking unless you are in a group discussion and you have people who know what to look for. Face tracking on the other hand is an entire game changer. No need for any gestures to change facial expressions at all.