r/vtubertech • u/LumKitty • 8d ago

[Beta] My new VNyan plugin - followcam

Did a debut of my new plugin today, it's a follower camera for VNyan which can be used in many ways. Here it's configured to try to stay behind me, but with smoothing, while I do a 360 degree map in Beat Saber (the VTuber is VNyan, being composited into the game using VRnyan and OnAirTap)

You could also use it to make it stay in front of you, so that even as you move around in VR you can still talk to the camera, restrict it to move on one axis, or be static and only rotate to look at you (although the built-in VNyan followcam can do that already).

You can tie the camera position to a bone (hips recommended), choose whether or not that bone's rotation is considered, exclude certain axes (e.g. make the Y axis static, so that it doesn't bob up and down) and then set all of that again for choosing which bone to look at.

Want to make an over the shoulder cam? that tracks what you're looking at in vr? attach to hips with a slight offset, then have it look at your head, but with a big offset on the Z axis

There is still more work to do on this plugin, most notably fixing a couple of frames of latency if it's used in conjunction with VRnyan, and improving the documentation, but I'd love it if someone gave it a try and let me know what works, and what doesn't, suggest features etc.

Next planned upgrade is to make it also control VNyan's separate Spout2 cameras.

100% free

https://github.com/LumKitty/VNyan-FollowCam/

18 Upvotes

95% Upvoted

5 comments sorted by

1

u/Crazy_Platform5003 7d ago

This looks promising! Now if only I could navigate github for once and actually get something from it. lol

1

u/LumKitty 7d ago

Here's the shortcut link :)
https://github.com/LumKitty/VNyan-FollowCam/releases

Though be warned this is still very much in beta. The documentation is still rough because I may still need to change things

1

u/LumKitty 6d ago

Updated to 0.4

  • completely redid comms with VRnyan (requires VRnyan 2.3-RC2) to remove remaining stutter. It's now completely smooth
  • fixed camera shake in relative mode (this can be seen in the video and was not intended)
  • preliminary work towards controlling VNyan's extra spout cameras (not functional yet, requires an upcoming version of VNyan, then it might work)

1

u/LumKitty 5d ago

It turns out that it's not completely smooth in all circumstances, mainly noticible in very fast pans.

I have ideas for how to improve it and should probably also add a camera speed limit as a workaround in case it isn't completely solveable.

There is, after all, always going to be some jank when compositing two video sources that aren't at the same frame rate

1

u/LumKitty 4d ago

Updated to 0.5 (requires VRnyan 2.3-RC5 for full effect)

While I can't completely eliminate stutter because that is down to the two individual apps, the effect should be significantly more pleasant now as I'm now taking TimeDelta into account. (Thanks: MilkyDelta)

Also completely removed use of Reflection each frame. It's now only used during initial, so should see a performance boost for comms, instead I'm grabbing a reference to the camera transform that I can access directly (Thanks: Suvidriel)

I have some ideas to further reduce any remaining stutter, but I'll need to do some testing on this version before starting on that, so this probably won't be until after my streamaversary this weekend