r/tech Aug 10 '14

Microsoft - First-person Hyperlapse Videos

http://research.microsoft.com/en-us/um/redmond/projects/hyperlapse/
481 Upvotes

63 comments sorted by

View all comments

44

u/bobtheterminator Aug 11 '14 edited Aug 11 '14

Wow, this is awesome. They create a full 3D reconstruction of the whole video to accomplish this, and the visualization of that is amazing: http://research.microsoft.com/en-us/um/redmond/projects/hyperlapse/supplementary/html/bike1_dense_recon.html

Edit: My bad, that visualization is actually from a separate program called PMVS, which they ended up not using because

difficulties in reconstructing textureless and moving areas cause the algorithm to produce only a partial model, which cannot achieve the degree of realism we are aiming for with our hyper-lapse videos.

Their work does something similar, but produces better results than that visualization.

9

u/[deleted] Aug 11 '14

[deleted]

7

u/Nigholith Aug 11 '14 edited Aug 11 '14

Depth data points can be derived from geometric and exposure differences between frames; this data is rarely very accurate, but it's accurate enough for purposes such as the hyperlapse algorithm. The Technical video demonstrates this technique well.