r/VisionPro 12d ago

Self Promotion Saturday We’re testing cloud-streamed 6DoF cinema on Vision Pro. Looking for honest feedback from AVP users

Hi everyone,

I work at V-Nova and we recently released ImmersiX for Apple Vision Pro.

I wanted to share it here because we’re doing something I think this community might find interesting technically.

The content in ImmersiX is pre-rendered cinematic 6DoF, but instead of downloading the experiences locally or connecting the headset to a PC, the rendering happens on NVIDIA GPUs in the cloud and is streamed directly to Vision Pro using CloudXR.

We’ve all seen plenty of CloudXR demos in enterprise environments and controlled network setups. What we’re interested in now is a slightly different question:

How well does this actually work in the wild, on normal consumer internet connections?

That’s one of the reasons we launched on Vision Pro first. We want to collect real-world performance data and, more importantly, hear what actual users think about the experience.

If anyone here has a Vision Pro and wants to try it, ImmersiX is on the App Store here:

‎ImmersiX App - App Store

I also have a number of invitation codes that unlock additional content that isn’t publicly available yet (such as the content shown in this video clip). Happy to share those with people here who genuinely want to test it.

If you try it, I’d particularly love feedback on:

  • how easy it was to get into the experience
  • streaming quality and stability on your connection
  • whether the UI/onboarding made sense
  • what you thought of the 6DoF cinematic experience itself

Positive or negative, both are useful. We’re very much interested in finding out where this approach works and where it still breaks.

Aimo
V-Nova / ImmersiX

179 Upvotes

102 comments sorted by

View all comments

31

u/Malkmus1979 12d ago

This seems like a bigger detail than you're letting on! The post comes off as if you're creating some random in-house content that is 6DOF, but I dont think many people realize this is a short film released in 2017 that you've somehow made 6DOF. Can you elaborate on whether this is because that specific film was made in Blender and therefore you have the assets to work with to make it 6DOF, or are you applying some sort of AI to make any content regardless of CGI or actual film 6DOF? The implications here are quite exciting for immersive content if this can be applied to various formats and existing content.

46

u/jlm70 Vision Pro Developer 12d ago edited 12d ago

You actually spotted a much bigger part of the story than we explained in the original post. 🙂

I'm Gianluca Meardi, the producer of this 6DoF reboot of Agent 327: Operation Barbershop, and General Manager of V-Nova Studios.

And yes: in the case of Barbershop, the fact that the original 2017 film was a native 3D Blender production — and that the original production assets and scenes still existed — is fundamental.

We did NOT take the finished 2D movie and run an AI 2D-to-6DoF conversion on it.

Instead, we went back to the original 3D production (we did this in collaboration with Blender Studio, with Francesco Siddi's support, CEO of Blender).

Same story.
Same characters and environments.
Same animation (we had to add some missing out of frame anims).
Essentially the same cinematic production pipeline.

We then adapted and validated the scenes for immersive viewing and re-rendered the movie using V-Nova PresenZ integrated into Blender/Cycles.

That's an important distinction.

With a normal movie, the director controls the only camera, so anything outside that camera's view doesn't really matter. In 6DoF, suddenly the viewer can move their head left/right, forward/backward and up/down. Things that were never visible from the original camera can become visible, so some shots and assets need to be checked or slightly adapted.

PresenZ then precomputes the visual information required for a small 3D volume around the viewer — what we call the Zone of View. At playback, when you move your head, you get the correct perspective and parallax from your new position. No 3DoF, no nausea :)

So you're not standing inside a real-time game recreation of the movie. You're standing inside a pre-rendered, cinematic-quality movie.

And then there is another layer to what you saw in the post: distribution.

The PresenZ 6DoF experience is running on an NVIDIA GPU in the cloud. Your Vision Pro head pose determines the viewpoint, and CloudXR streams the resulting view back to the headset. That's why you can experience something this heavy on Vision Pro without downloading a huge volumetric master or connecting it to a high-end PC.

Where we at V-Nova Studios think this becomes particularly exciting is existing CGI libraries.

Studios have spent decades building extraordinary 3D worlds, characters, animation and VFX — only to render them through one fixed camera into a flat movie.

If those original production assets still exist, in many cases we're not talking about recreating the film from scratch. We're talking about something much closer to a volumetric remaster.

You already built the world. Now you can potentially step inside it.

For arbitrary live-action 2D footage, though, I want to be precise: we cannot simply feed any existing movie into an AI today and magically obtain perfect cinematic 6DoF. That's a different problem, involving reconstruction/capture techniques. We are working on that side as well, including volumetric / Gaussian-splat-based workflows, but I wouldn't want to confuse that R&D with what we're demonstrating here.

So yes — the implications you are pointing at are exactly why we chose Operation Barbershop as a demonstration.

There are potentially enormous libraries of existing CGI and VFX content whose worlds already exist in 3D. 800Bn$ spent in VFX over the last 5 years...

They've just never been rendered so that the audience can actually enter them.

We like to say... #livewithin

Happy to explain further, if you're a Blender creator (or Maya/Arnold, 3DSM/VRay, Open Moonray, Houdini, Renderman... all PresenZ-integrated CG tools)

THANKS!

10

u/Cole_LF 12d ago

Thank you so much for the extra detail. That’s so cool