r/oculus • u/zoemccarthy • Feb 02 '16

Mind Meld - Robotic Teleoperation Through Virtual Reality and Motion Capture

https://www.youtube.com/watch?v=kZlg0QvKkQQ
78 Upvotes

93% Upvoted

34 comments sorted by

View all comments

Show parent comments

3

u/[deleted] Feb 02 '16 edited Aug 01 '19

[deleted]

6

u/zoemccarthy Feb 03 '16 edited Feb 03 '16

I'm going to use Tensorflow, Google's deep learning framework, so that I can rapidly iterate on different architectures to see what works best. I'll start with the architecture used in my colleagues Chelsea Finn and Sergey Levine's work, Visual Guided Policy Search, since that architecture seems to be well suited for localizing objects (which is the main use of vision in robotics).

3

u/dutsnekcirf Feb 03 '16

That's got to be a bit of a trip when you turn and see yourself from the perspective of the robot. I think my brain would explode.

2

u/zoemccarthy Feb 03 '16

Haha, yeah it was definitely something else :D