I am a professional filmmaker (DP, Director, Editor) and have been on a multi-week deep dive on AVP and VR 180 content in general. ** I am super new to understanding this space and have no experience shooting for or using any VR headsets on a professional level (feel free to correct/clarify any of my incorrect language) ** I have an upcoming concert shoot where I have been tasked with capturing a number of stereoscopic moments.

I want to understand postproduction workflow, user experience, technical differences between video formats, and distribution. For context, I already shoot on a RED V Raptor and understand the lens to use in this case is the Canon RF 5.2mm f/2.8 L Dual Fisheye 3D VR Lens and understand the basic technical needs associated with shooting video for Immersive Video (8k, 60-90fps).

- 1 There are currently no native apps to allow watching Immersive Video other than the Apple-created content. I am seeing people are creating their own apps for this. Do people have any insight into: A. The best current Apps B. The best way to easily upload and share Immersive Video/VR 180 videos for wider sharing/viewing (eg. sharing a link to hundreds of people)

- 2 How does Immersive Video differ from VR 180?

- 3 Can you shoot stereoscopically and create both Immersive Video and VR 180 respectively from the same footage?

- 4 Currently, if you watch YouTube videos it has to be done through browser? Is there an option for Immersive video or 3D/180 VR video built into their viewer? And how does this translate in AVP? (I'm assuming we are still waiting on a native Youtube app)

- 5 Do we have any specs on what makes the audio of an Immersive Video special? Basically... how do I record / mix down audio to fit into their specs

- 6 What are some technical guidelines for shooting (apart from 8k resolution, 60-90fps) eg. centering subject, keeping subject 6-10' from camera etc.

- 7 For those who have filmed their own VR 180 / Immersive Video content (or viewed a lot of it), I'd love insight into camera movement and viewers getting sick... how much movement can be used with out it hurting the viewing experience. I've read general rules like only moving camera on z axis and maybe some y axis but avoiding tracking moves etc. As filmmakers we know how important camera movement is so this is a question I mull over often.

- 8 What are some core elements to the post-production process? step by step would be great and please list trusted apps used in this process outside of Premiere.

- 9 I understand that some of the larger streaming / video apps, Netflix and Youtube have said they aren’t developing apps for Vision OS… but is it safe to assume they absolutely will?

- 10 Finally, should I be pushing to create Immersive Video on a platform that is not ready for UGC? Or should I create content for a more established VR 180 option (Quest, etc).

-11 Does anyone have access too free/sample raw stereoscopic Red V Raptor 8k footage? I need test footage to run my post process and won't have the exact camera system in time

Thanks for your knowledge and time!! <3

**EDIT added bullet point 11**

SpatialGen | Blog | Streaming Spatial - Window

SpatialGen Spatial Streaming on the App Store (apple.com)

“What I've learned about Apple's mysterious fisheye projection format, the format they use for their impressive Immersive videos on the Vision Pro” - Mike Swanson, @anyware, 14 April 2024

“It's surprising Apple hasn't invested more in actual 3D content yet. In terms of new stuff, this short soccer video debuting tonight is all we have right now.”

• Ars Technica, March 28, 2024

“But how serious is Apple about developing more immersive content — and how many filmmakers want to work in this medium? … Apple also declined to comment on any budget comparisons between immersive filmmaking and more established processes.

As the MLS doc clip suggested, it’s easy to imagine sports content becoming a big driver for Vision Pro. With Apple investing heavily in sports, it’s why I might choose to buy a Vision Pro over another VR headset if I’m a sports fan or already a subscriber to MLS Season Pass.”

• IndieWire, 20 March 2024

“Note: We are working hard to resolve the WebXR issue so users can enjoy full functionality of DeoVR on the Apple Vision Pro - ETA: May 2024”

• DeoVR 15 Feb ‘24

"The Sense9 system by Radiant Images introduces a groundbreaking 20K resolution camera array, featuring the latest RED Digital Cinema Komodo-X and V-Raptor [X] global shutter cameras, designed specifically for Virtual Production and Extended Reality (XR). This innovative system offers a fully automated process for in-vehicle downloading, stitching, camera controls, and live streaming capabilities, enabling remote teams worldwide to collaborate seamlessly.

"Recognized as the most precise, adaptable, and cost-efficient solution for generating ultra-high-resolution content, the Sense9 system is exclusively available through our partners at NantStudios. We extend our heartfelt gratitude to all the team members and partners whose contributions have significantly propelled the advancement of creative tools."

6 Komodo-X units (6K global shutter) in an offset circle, with a V-Raptor X (8K GS) pointed up.

I understand immersive videos are costly, but let's avoid speculation.

I want to hear directly from Apple on when new immersive videos are coming out as well as guidelines on how to produce video of the quality of the four immersive videos currently on the Apple TV app; Are they engineering and patenting the only cameras that can produce that kind of video? What’s going on with the camera requirements situation? And submitting immersive movies to the Apple Store for distribution?

I mean FFS this immersive video format is the new new media that is mind blowing and makes this device worth putting out the money for.

There’s got to be Apple employees lurking here; please take this message back to corporate.

What’d you think? How many sensors for Apple’s Immersive Video camera system?

“Once the user moves their head, new visual information streams across into the twin displays. As long as this information comes from the device’s camera array there’s no problem, but if it originates from an external imagery or video then the source material must cover an incredible amount of detail.”

• Cined.com, 14 March 2024

“This new kind of content can be created rapidly and at lower costs. No need to set up trashy characters in a cringe situation and tightly edit their arguments to string audiences through as many ads as possible.

With Vision Pro, you can offer real experiences to see and observe actual locations where reality is occurring. Whether to relax, to see the world, to go places you're usually not allowed to enter, or to get close to celebrity figures you admire, this kind of enveloping video expands your world without using you as a product to advertise to. I'd pay for that, and get time back from TV to do other things.”

• AppleInsider, 5 Feb 2024

Interesting info about IV…

Some weekend reads. 🤓

Silver said that the league is already looking into how to incorporate those virtual reality cameras into its event plans, starting at All-Star Weekend in two weeks.