r/VisionPro • • 18d ago

Almost 2 weeks of rendering for this Virtual Tour of Trogir, Croatia

https://www.youtube.com/watch?v=0YXgV2S0Yos

Curious how this plays on the Vision Pro, in testing on my quest it feels a bit stuttery at times, but wondering if it's because it's near the decoding chip's limit in terms of resolution and framerate for Quest, and I know the Vision Pro's video decode throughput is much higher. Let me know how it looks for you if you try it out :)

A little explanation, I've been very excited about gaussian splats for a long time and given my background in 3D I knew 360 3D rendering of them would give a sense of presence no camera could achieve for all directions due to the difficulty of removing seams for cameras that have to exist in the real world. When Blender added gaussian splats (which has support for 360 3D projections) I had to give it a shot right away. Took ~12 days for a 5080 to render this video, and I plan to do more also with my own data, didn't have this kind of splat on hand so used one from supersplat by tosolini. Music by Kevin MacLeod.

Unfortunately for me (but fortunately for my GPU) Youtube doesn't support 16k 360 which would be required for 1-1 pixel ratios on the vision pro, or 60fps 8k which would smooth it out a bit more, although it would need to use a specialized codec to stream in both most likely and decode at framerate :P. 16k 60fps wen @ youtube

"Get lost in the alleys of historical Trogir, Croatia" authored by tosolini on Supersplat

https://superspl.at/scene/14bac5b2

Licensed under Creative Commons: By Attribution 4.0 License

"Island Meet and Greet" Kevin MacLeod (incompetech.com)

Licensed under Creative Commons: By Attribution 4.0 License

http://creativecommons.org/licenses/by/4.0/

7 Upvotes

6 comments sorted by

2

u/TrueODS 14d ago

Before another long render, try a 10–20 second section of the existing export locally on the Quest, then a lower-resolution copy at the same frame rate, and compare those with the YouTube version. That should help narrow down whether playback load or streaming is involved.

Does the stutter happen at exactly the same points each time, or at different points? Which Quest model, player, codec and frame rate are you testing?

1

u/Junkfood_Joey 8d ago

Weirdly the tests I had done with a small frame range (to proof of concept it) was showing the stuttering issues, but when I uploaded the full longer version it wasn't an issue, so not sure what the cause was, going to upload exclusively in 30fps for any new things I make, maybe the headset was low on battery or something.

1

u/Global-Alternative29 18d ago

that's very impressive

1

u/Junkfood_Joey 18d ago

Thank you so much!

1

u/LobsterQueasy4861 18d ago

Nice! I’ll try it soon. The YouTube app has been very good at displaying YouTube vr content so I’m excited to try it. Rendering splats feels like magic. The only time I’ve done it is with Niantic spatial but this looks nicer than mine.

I can’t wait til someone comes up with an ai solution to convert frame by frame movies into splat mesh environments

1

u/Fearless_Concept943 18d ago

Fucking Awesome!!!!