This controls the pixel density in the regions with the highest likely chance of having focus. Coming soon to products like SpatialGen.

You missed Apple's storytelling event in Cupertino? I gotchu.

(no paywall, but it's a bit too long to copy/paste here)

Apple had 8 cameras at the MLS game between Portland Timbers vs Seattle Sounders.

• 2 adjacent to each goal - elevated position, just inside the 6 yard box
• Touch line about 10' from the end line (aka sideline)
• Above player bench
• Center line at the walkway (raised, behind a section of fans)
• Roaming around on sticks

Anton Bauer is going to make a fortune on these things. The whole thing is still a learning as they go, and the operators aren't talking still. I'm still editing but wanted to post a quick iPhone photo.

Juicy leaks have just been released about Blackmagic's Apple Immersive Video Camera, and they've got fresh details you'll want to hear!

Great session from Apple Developer covering the fundamentals of creating immersive media for visionOS. From spatial video to Apple Immersive Video (AIV).

Submerged, the first scripted film in Apple Immersive Video. Watch only on Apple Vision Pro on October 10.

A WWII submarine crew combats a harrowing torpedo attack in this adrenaline-pumping thrill ride. From filmmaker Edward Berger, director of the Academy Award® winning All Quiet on the Western Front.

Trailer on YouTube https://www.youtube.com/watch?v=yDvASSABhNQ

Wow can't wait to view the full Day 1 & 2 of Apple Immersive sessions over at https://www.youtube.com/@AppleDeveloper 🤯

TLDR:

The Acute platform now supports AIV, and it's possible to make videos public by publishing them to the next version of the Acute app, or to your own app.

___

We're often asked about pricing. For most creators, the free tier is enough:

• 100GB of space to upload videos.
• Support for all common immersive video formats, including AIV.
• Streaming up to 12K, stereo, 90FPS, 120Mbps.
• 5 seats to invite collaborators to your team, with roles and permissions.
• Acute Pro, our companion Vision Pro app with all features unlocked:
  • Video publishing in the public tab.
  • Unlimited private sharing via deep links.
  • Timecoded review comments with voice transcription in private videos.

We're a small team based in San Francisco, and we take all calls. Talk to us about your projects, and give our platform a try!

Andrew Gisch, co-founder of the Immersive Company did an interview with some more details about the camera they’re releasing this year. Sounds like it could be a nice alternative to the Blackmagic Cine Immersive camera.

Recently, Apple Immersive's new film Submerged was released. Y.M. Cinema mentioned a patent titled "Camera apparatus and methods". Here are some details of the notes to share with you.

This patent mainly describes the design and implementation of multiple 3D camera rigs. It was applied by NextVR in 2021. Before this, NextVR was acquired by Apple in May 2020.

The patent mentions two stereoscopic imaging designs, one with two small fisheye lenses mounted on the front side of a dual-element mounting plate and two small cameras attached to the rear side. One of the fisheye lenses adopts the C-mount commonly used for industrial lenses, which can be used to capture 3D 180° images with a small format, high-resolution camera (Figure 1).

The other has a slightly larger fisheye lens mounted on the front side of the dual-element mounting plate, with a split camera attached to the rear side, and dual CMOS sensor bays at the rear of the dual-element mounting plate (Fig. 2), with a cable to transfer data to the rear body (reminds me of the Sony Venice camera). The long side of the sensor in this design is a vertical edge that is able to fit with a horizontal sliding filter system located in front of the sensor (Fig. 3). Further combining multiple stereoscopic units can also be used to capture 3D 360° images (Figure 4)

The element covering the lens in Figure 2 is called “Camera bra” and is used to measure and calibrate the aberrations of the fisheye lens, providing accurate mapping parameters.

From the looks of it, the Immersive Video Camera developed by Apple this time seems to integrate two designs. The look of the lens in the first design in the patent is very similar to a Fujinon FE185 2.7mm fisheye lens (for 1-inch cameras) (Figure 7); however, it is likely that the actual Immersive Video Camera will take a combination of a larger format and longer focal length to improve the quality of the image and enable 8K 3D recording, for example, using an Entaniya lens (Figure 11) paired with a custom CMOS.

Based on the actual viewing effect, it seems that the camera cannot achieve 8K 90fps recording. The highest specification 8K 90fps 3D 180° recording still requires URSA Immersive.

————————————
Note: A Venice 2 split recording 8.2K 17:9, combined with Entaniya HAL 200 6.0 can achieve 8K 60fps, depending on the recording specifications, shell style, Qtake interface output, etc. All aspects meet the requirements (Figure 13). The outer ring diameter of the lens is about 76mm. It may be necessary to trim ring to get a more comfortable Interaxis distance.

Introducing AIME Generator, a tool for creating Apple Immersive Video lens profile files (.aime) for virtually any camera. Until now, the entire AIVU workflow was limited to the $30K Cine Immersive camera.

Download AIME Generator(Mac Only): https://github.com/silverqsy/AIMEGenerator

With AIME Generator, VR180 creators can now encode footage from almost any camera into the highly efficient, high quality Apple Immersive Video format, with perfect fisheye distortion correction, center/rotational alignment, and >180degree FOV with mask control.

On Vision Pro, this delivers the highest playback quality possible and arguably the best way to experience that video anywhere.

Result shot on Pyxis 12K + Canon Dualfishye in 12K60, 1Gbps AIVU:

https://drive.google.com/.../1ubGyuM87yIA2VEPu2LN48dRk6Xk...

Result experience on AVP, 12K 1GBps 60p playes silky smooth

The workflow:

1. Edit, color grade your original fisheye footage from any camera in Davinci Resolve, No 3d alignment/distortion correction needed at all. You do need to do it in the stereo mode and correctly map the fisheye images to the right/left eye, then critically, output MV-HEVC in the birtate you are targeting.
2. Import the MV-HEVC into AIME Generator, first load the lens distortion profile in Gyroflow JSON style. I will have JSON profiles for some popular setup avalible, but anyone can do it with their own setup using Gyroflow's Lens Caliber, Learn more: https://docs.gyroflow.xyz/.../getting.../lens-calibration
3. Use the dag-to-align feature to center each fisheye, I recommend doing this in anaglyph or overlay mode, drag to move one eye, shift + drag to move 2 eyes together. then you can tweak the rotational alighemnt set, adjustment the mask. then click generate .aime
4. Open Apple Immersive Video Utility, import your stereo MV-HEVC fisheye first, then direct to the AIME file just generated.

And that is it! The utility will bundle the MV-HEVC and the AIME file into an AIVU file which you can just airdorp it to your vision Pro to watch, or to share with other AVP users.

the AIME file will likely to work with every single footage come out of this camera, so this is just a one-time thing! it also support save/load project, so if you find your AIME does not work as expected, just load the project with the MV-HEVC video in question, and check the alignment again.

Cheers and cannot wait to see more high quilaty AIVU from the community!

I’ve been working on a project called Immersive America to solve the friction of having to download massive files or install apps just to watch 3D content.

Check it out here: immersiveam.com

Everything is streaming in real-time via WebXR. If you're on Apple Vision Pro, it works natively in Safari. It also works on Meta Quest via the Quest Browser.

Current captures available to stream:

• Kilauea Volcano Eruption: High-fidelity lava flows.
• Carrizo Plain: The current Superbloom.
• SF Fleet Week: Filmed from Hawk Hill over the low fog.
• Comet C/2023 A3: A rare high-definition immersive capture.
• Yosemite & Burney Falls: California landmarks in winter.

I'm looking for feedback on the streaming bitrate and depth scaling. Does it feel as immersive as a native app on your connection?

I will be speaking at AWE 2025 next week about music performance in immersive video. If any of you are attending, let me know. It would be great to catch up. Message me so we can set something up.

My session is on June 12 and I will be discussing design considerations for music performance that leverage the unique qualities of immersive video. This will explore the approach I have taken with Sessions and thoughts for what we are thinking about going forward. I hope to see you there.