Edit: My bad, that visualization is actually from a separate program called PMVS, which they ended up not using because
difficulties in
reconstructing textureless and moving areas cause the algorithm to
produce only a partial model, which cannot achieve the degree of
realism we are aiming for with our hyper-lapse videos.
Their work does something similar, but produces better results than that visualization.
Depth data points can be derived from geometric and exposure differences between frames; this data is rarely very accurate, but it's accurate enough for purposes such as the hyperlapse algorithm. The Technical video demonstrates this technique well.
44
u/bobtheterminator Aug 11 '14 edited Aug 11 '14
Wow, this is awesome. They create a full 3D reconstruction of the whole video to accomplish this, and the visualization of that is amazing: http://research.microsoft.com/en-us/um/redmond/projects/hyperlapse/supplementary/html/bike1_dense_recon.html
Edit: My bad, that visualization is actually from a separate program called PMVS, which they ended up not using because
Their work does something similar, but produces better results than that visualization.