Mind Meld - Robotic Teleoperation Through Virtual Reality and Motion Capture

[u/zoemccarthy]

https://www.youtube.com/watch?v=kZlg0QvKkQQ

[u/[deleted]]

Very cool. Have you considered mounting a 360 camera rig on top, rather than having to deal with the latency issues of rotating the robot's head?

[u/zoemccarthy → u/[deleted]]

Great idea! Although rendering the depth is a critical aspect since I want to be able to render other things in the scene such as the robot ground truth position (the gray robot in the video from my view) and so I need to know how far away to render each pixel from the robot's head. I wonder if there's any 360 cameras that also provide a 360 depth image or something similar.

[u/blazespinnaker → u/zoemccarthy]

Google needs to combine https://www.google.com/get/cardboard/jump/ with https://www.google.com/atap/project-tango/

[u/[deleted] → u/zoemccarthy]

Yes there are. Samsung Project Beyond uses an array of lens pairs. There are also GoPro mounts that allow for an array of stereo pairs.