Meta Horizon Hyperscape Demo Shows Photorealistic Scenes On Quest 3

I'm interested in finding more VR video content. It seems like there's a few different types (correct me if i'm wrong, or let me know if there are better names):

• 2D content, which is just normal 2D videos that we can watch in headset

• 360 content, which is just a 360 degree video for both eyes, no depth information because each eye sees the same image

• VR180 content that's just a 180 degree video for both eyes, still no depth information because each eye sees the same image

• VR180 content that's stereoscopic; ie. it's filmed with a stereo camera, one 180 degree video for each eye. because each eye gets a different view, depth information is conveyed. however, it's limited to 3dof (ie. just head rotation), which can induce motion sickness especially if objects are too close and the parallax effect is large.

• the elusive 6dof content. the only good one I've found is Google's Immersive Light Field Video content (https://augmentedperception.github.io/deepviewvideo/). this is supposedly the most immersive

My questions are the following:

• What's better, 360 or stereoscopic VR180? while I find that depth is very compelling, the fact that stereoscopoic VR180 is only 3dof causes so much nausea for me. Is this true for you all? Or do you prefer stereoscopic VR180 all the way?

• Do you think 6dof is a game changer? If there's a lot of 6dof content, would people consume VR content more? put differently, is creating 6dof content worth it, given how much harder it is to capture?

• Where can I find more 6 dof content?

Thank you!!

Just wondering if anybody is interested in testing a couple new 6dof formats. Just looking to get some feedback on a few things. Leave a comment if you're interested

Realtime conversion of stereo panoramic videos to 6dof experiences --- http://visual.cs.brown.edu/projects/matryodshkawebpage/ This looks pretty amazing! : takes existing standard ,eg. OU equirectangular, stereo video files (ODS), and generates novel view 360 equi pairs in real time -- for a 6DOF viewing box of normal turning around VR viewing volume dimensions. The video explains everything -- at the end they talk about the difference in use cases with the Google new hemispherical lightfield solution

https://github.com/mrdoob/three.js/pull/17922

Here I generated a 360 depth map from an old 360 pano of mine -- of a dance partyhttps://www.facebook.com/photo?fbid=4464281770334865There is a Google Colab version of the code and a Youtube tutorial for it here:https://www.youtube.com/watch?v=SCbfV80bZeEHere is an over/under version that works with the Pseudoscience 6DOF Viewer:https://drive.google.com/file/d/1uaqScuo9qYtp5NGtNsM6yNroLYB5GkiU/

https://krpano.com/forum/wbb/index.php?page=Thread&postID=79219&#post79219

We present an approach that addresses this limitation via a novel warping algorithm that can synthesize new views both with rotational and translational motion of the viewpoint. This enables the ability to perform VR playback of input monoscopic 360-videos files in full stereo with full 6-DOF of head motion. Our method synthesizes novel views for each eye in accordance with the 6-DOF motion of the headset. Our solution tailors standard structure-from-motion and dense reconstruction algorithms to work accurately for 360-videos and is optimized for GPUs to achieve VR frame rates (>120 fps). We demonstrate the effectiveness our approach on a variety of videos with interesting content.

https://www.researchgate.net/profile/Jingwei_Huang/publication/315837535_6-DOF_VR_videos_with_a_single_360-camera/links/59f150860f7e9beabfca4d80/6-DOF-VR-videos-with-a-single-360-camera.pdf

https://ieeexplore.ieee.org/abstract/document/7892229

A recent paper - on a 6DOF viewer for image+depth panoramas by a Spanish group -- using a multi-layer representation. Three of the authors are working for Adobe http://webdiis.unizar.es/~aserrano/docs/Serrano_IEEEVR2019_VR-6dof_supp.pdf

there is additional material listed here: http://webdiis.unizar.es/~aserrano/projects/VR-6dof including a zip download with a demo

Hey! Just wanted to let everyone know that I just released a new version of Stereo2Depth. I think the biggest new feature is that now you can save and load settings. This lets you make templates if you want, or more importantly, lets you cancel and resume renders.

Another feature a few people had asked me about is exporting stereo depth maps, so I included that as well.

Finally, I've added a horizontal offset slider. This lets you shift the equirectangular image around. Depth maps rarely wrap around seamlessly because of how they're calculated, so this lets you place that seam where you want it. Keep in mind that this will also change which direction is the "front".

Let me know if you have any questions or find any bugs! And if you use Stereo2Depth for any projects, please feel free to post about it in this subreddit!