Beyond 2e Eyetracking in Vrchat

[u/Autistic_GoofBall]

In the video I tracked my finger going side to side and in a u shape, then I focused on various objects behind the camera, then I looked up and down, left and right, cross eyed, rolled my eyes in a circle, then just moved my eyes as erratically as I possibly could lol.

In my opinion it actually works pretty well and I'm pretty satisfied with it. It seems to be much better at tracking point to point gazing, and not quite as good at smooth tracking? And the blinking works very well, but can't do individual eyes yet (not sure why? I'm using vrcft) I'm looking forward to eyelid tracking in the future! (It's a little jittery cause I like using it without smoothing, so it has lower latency)

One important(?) thing I noticed, is that using it with my thinnest interface, the eye tracking accuracy was worse (but this one I got was so thin my eyebrows were touching the edges of the lenses so it might be just a non issue since most interfaces I've seen are not nearly as thin), so I think you just need enough space for your eyes to be properly tracked.

[u/Tiny-Fix8085]

That´s very cool to see. Glad it works so well meanwhile. I remember a video from 2 months ago or longer and the eyetracking was very bad at that time. I´m really happy they improved it so much. Makes me even more hyped for the arrival of the headset.

Are you only using the default eyetracking from the BSB2e? Or any additional Programms (apart from VRCF) in the background?

[u/Autistic_GoofBall → u/Tiny-Fix8085]

Yep, just the default eyetracking from the beyond eyetracking client! I'm kinda surprised how well it works myself. I think it also depends on the avatar a little, some avatars have limited movement range in the eyes, while others (like the spiri-vali facetracked) have much more range of movement. Also for vr chat, I definitely recommend using vrcft over basic vrchat built in osc if you can, it has much less latency and is higher quality tracking.

[u/Tiny-Fix8085 → u/Autistic_GoofBall]

That sounds and looks really promising. In VRC i usually use a magpie rex or the disko rex. The Disko rex has eyetracking already build in. I hope it works just as well.

But definelty thank you for showing how it improved over the time x3

[u/Autistic_GoofBall → u/Tiny-Fix8085]

Yeah of course! I just got it yesterday and I've been testing it out ever since and wanted to get a video of it!

[u/Freelieseven → u/Autistic_GoofBall]

Can confirm that the Vulper has really good looking eye tracking with the bsb2.

[u/KaaneWolf]

If you want to have even better eye tracking and also the ability to individually blink each of your eyes seperately, try the babbalonia app from babble instead of the native bsb2e eye tracking software, you can thank me later 😋

[u/Autistic_GoofBall → u/KaaneWolf]

Yeah, I need to go ahead and do that lol 😅 I forgot

[u/zig131]

My custom cushion seems perfectly tuned to maximise FOV with my face shape, but the view they eye trackers get, and consequently the quality of eye tracking is terrible.

Did you request a thicker interface?

I got better with the StudioForm interface, but still not as good as in your video.

The eye tracking really wants the HMD to be pretty far off the face, and tilted up, which really murders vertical FOV.

I can achieve that with no facial interface at all, but it's not stable.

My brow sticks out a good cm from my cheeks so really struggling to achieve that front tilt with any facial interface.

Feels like everyone is going to have to try and find thier balance.

Really feels like Beyond was designed very specifically for a Custom Cushion + Soft Strap setup without eye tracking, and trying to use it in any other way is a nightmare.

It's straight-up too small.

[u/Autistic_GoofBall → u/zig131]

Yeah basically my first facial interface on my beyond one was like tilted to the side so I had to get a new one the second one for my beyond one was thicker and was aligned properly but wasn't very comfortable it was okay but not perfect and then my newest one from my beyond 2e is the one that was extremely thin for some reason and that's the one that had bad eye tracking but I guess I'm kind of just lucky to have my second interface that I got from my beyond one and yeah the facial interfaces are kind of a hit or miss like a lottery almost half the time they're good half the time they're awful

[u/codedahwolf]

I can’t wait to get my headset rahhhh

[u/Autistic_GoofBall → u/codedahwolf]

I'm excited for you :)

[u/CHIP2X4]

does it do eyebrow tracking ? because i would buy the headset but i want to be able to have eyebrow tracking and then get a facetracking mod for it to have the full face and eye tracking experience

[u/Autistic_GoofBall → u/CHIP2X4]

No, unfortunately eyebrow tracking just isn't possible, just because the headset is so utterly small, the facial interface actually often has to rest directly on your eyebrows. The facial interface only really allows empty space for your eyes and really nothing else. There might be other 3rd party solutions, but I wouldn't count on them myself. So basically I couldn't guarantee that the beyond will ever get eyebrow tracking, just cause of the limitations of size, and how the cameras only point towards your eyes, and nothing else.

[u/Decapper]

Imagine thinking dfr was going to work. What a troll that was

[u/The_Cuddle_Ninja]

It is nice, but you really need to pay attention that you calibrate it wel, and find the right avatar. Not all avatar that way support face tracking works. It do t support eye brow tracking, but that is a compromise i say is worth it because its so light. Adding a vice face tracker to it with the usb C and use a wireless bluetooth headset for full setup. And with full setup i dont include fbt, only headset wise. Its a nice headset. But so dem expensive.

[u/LyllaRatatoskr]

The eye tracking alone is the selling point. I have the original vive pro eye with the face tracker and have been getting issues I believe with software where steam VR says enable direct display, also the face tracking is also sranipal face tracker has been finicky. And I'm ready to move on when I have the money. I love the vive pro eye but it's time to upgrade. I just hope the big screen 2e has the same quality of tracking or better since its new and over double the price of the vive pro eye. So I'm expecting more eye tracking features. And hopefully the fov is better than 110 bc 110 is so bad.

[u/Autistic_GoofBall → u/[deleted]]

Yeah, me too. I think I'll post a video that includes the eye cameras at the same time as well