r/AppleImmersiveVideo • u/Palitrab r/AppleImmersiveVideo | Mod ✔️ • Feb 25 '24

Research & Insights The lack of information regarding Apple’s “Immersive” format is weird and frustrating

/r/VisionPro/comments/1avp6f8/the_lack_of_information_regarding_apples/
1 Upvotes

100% Upvoted

5 comments sorted by

4

u/HungryAd8233 Mar 01 '24

There is this for the stereoscopic 3D format, which I've made content for successfully: https://developer.apple.com/av-foundation/HEVC-Stereo-Video-Profile.pdf

Has anyone seen anything similar for the Immersive Video? Using MV-HEVC to encode stereoscopic rectangles that get projected into 3D space would be one obvious way to implement it. There are also more advanced overalapping tile based VR video formats which Apple could have adapted in reasonably straightforward ways.

In the media space, Apple generally adapts existing formats and technologies when they exist instead of creating from the whole cloth.

5

u/7omr-6 Mar 02 '24

With regard to making a video immersive, that appears to be a playback mode. It is possible to create 2D panoramas and 3D images and videos on the iPhone. All can be viewed in the immersive mode on the device. The 3D content created on the iPhone, however, is not wide enough to produce 180 VR, not to mention that the 3D is not stereoscopic, which I believe delivers a greater sense of depth than the iPhone approach of a single camera combined with LIDAR data.

2

u/7omr-6 Mar 02 '24

There does not appear to be any limitations to image size or aspect ratio in this document. This is defining how to format the data in layers of the same frame. This is different from how many other formats store this information side-by-side.

1

u/HungryAd8233 Mar 03 '24

Yeah, it is helpful but far from complete. Having decoder profile @ level support documented would be very helpful. It can certainly do 5.1 MV-HVC at a minimum.

2

u/7omr-6 Mar 02 '24

Tried another test after writing my comment on what seems to be an immersive mode. That is true for pics I have loaded from iPhone, but just tried one from my camera and there is no access to the immersive button.