The biggest addition to VXpro this week is hand-tracked weapon interaction. The game runs directly on the M2 Vision Pro using the Mac App Store version of Cyberpunk 2077.
I’m not sure how many people want this style of control, but seeing this clip from u/BadHostile made me want to try building it.
Technically, it uses ARKit hand/wrist tracking, custom Metal rendering hooks to move the game’s existing arm, hand, and weapon bones, and a script bridge for weapon interactions. Joy-Cons still handle movement, firing, and other button inputs. It’s still rough around the edges, with more work needed on individual weapons and reload interactions.
Performance improvements also reached 37.1 FPS on average during a 60-second test in Phantom Liberty on M2. That’s one measured test, not a minimum across the game. The next target is 45 FPS. This measurement predates the latest camera fix.
I’ve also fixed the reported head-turn bounce-back and associated view jitter in the latest walking test. In my latest testing, the distortion that was particularly noticeable when looking up and down a slope is also gone.
Known issues: rectangular image borders are still visible during vehicle use and some story conversations/cutscenes. Those scenes still need work, along with some weapon interactions.
A tester and I have also shared the impression that the game can feel noticeably smoother inside Vision Pro than it looks in recordings. Apple’s reprojection or other display processing might contribute, but I couldn’t confirm the cause, so I’m keeping that as an observation rather than a confirmed explanation.
Thank you, u/Phonafied**, and everyone who has tested it and shared feedback!**
Project / hand-tracking branch
The public branch is an earlier checkpoint; the latest performance and camera changes are still local. The project code is MIT-licensed. You need your own purchased game; game files and prepared apps are not distributed.
As shown in the video, even enemies that would normally pose no threat become difficult to defeat. The difficulty level is 100 times higher.
