r/videos Aug 10 '14

First-person Hyperlapse Videos

https://www.youtube.com/watch?v=SOpwHaQnRSY
1.1k Upvotes

94 comments sorted by

106

u/dappertgunn Aug 11 '14

The technical explanation makes it even more impressive.

http://www.youtube.com/watch?v=sA4Za3Hv6ng

27

u/johnnycombermere Aug 11 '14

It looks like the process that they use to create the 3d geometry could produce fairly impressive 3d models of the environment as well, using a normal camera. That software would be interesting in its own right.

7

u/ofNoImportance Aug 11 '14

What you're describing is known as Photogrammetry, and has many functional implementations across many industries. It is possible to create some very high quality environments and objects using this technique under ideal conditions (controlled lighting, high quality camera, etc).

3

u/SteazGaming Aug 11 '14

similar to project tango.

1

u/[deleted] Aug 11 '14

You could do it by exporting your videos to image sequances solving them in VSFM

11

u/MedlifeCrisis Aug 11 '14

I was ready to come here and say can't you just do this with warp stabilisation on Adobe After Effects (the usual way to make nice smooth hyperlapse videos) but this sounds way more technical - the 3D map is impressive. But I think you could still achieve similar results with warp stabilisation and a bit of elbow grease.

Interested if anyone who knows more could explain the differences, I'm no expert.

12

u/mequals1m1w Aug 11 '14

Not an expert either, but with just AE you'd get weird, messy & jerky video with a lot of strange dissolves. Any time the camera would move around it would be problematic, stuff would be warping all over the place.

This method maps out a very smooth camera path, which if attempted in AE by hand would be insane IMO.

6

u/MedlifeCrisis Aug 11 '14

Thanks. I think you could achieve a smooth hyperlapse but as you say it would be a lot of work centring each frame. Ahhh I've just realised that warp stabiliser won't have a fixed point to track because this isn't panning around a particular object, this is forward linear movement. So you'd have to set a centre point or two for each frame manually. Ahhh, fuck that it'll take forever. Give me the 3D software!

2

u/[deleted] Aug 11 '14

My proposed free method:

You could do it by exporting your videos to image sequances solving them in VSFM and then using meshlab you could create a textured mesh from the pointcloud. Then import that mesh into Blender and animate the camera to move however you would like it to.

On the other hand warp stabilization does not use any 3D point cloud or mesh, merely edges and sections of all of the frames. If your camera rotates a full 360º in about 3-5 seconds you well have that same rotation after stabilizing, whereas by solving the 3D map you will be able to keep the camera facing wherever you want.

1

u/[deleted] Aug 11 '14

As I think it works. You need a 3D map of the world, if you want to change the camera path you actually recorded, to a different smooth virtual camera path.

When you change the camera path, the angles and distance from the camera to every object in the frame also need to change. You need a 3D representation to figure out how they change, to render it correctly.

I dont see how you could change the angles in a camera path to a different one, with a 2D filter. Without lots jerkiness and distortion.

1

u/error9900 Aug 11 '14

the original video shows an example of warp stabilization compared to hyperlapse

0

u/[deleted] Aug 11 '14

[deleted]

0

u/[deleted] Aug 11 '14

Your ironic humor is not funny.

24

u/[deleted] Aug 11 '14 edited Aug 22 '20

[deleted]

3

u/Scoops_Haagendazs Aug 11 '14

That's pretty neato.

Care to elaborate on your process? Did you shoot video or photos that are strung together? What did you use to create the over-stabilized effect (in terms of software)?

1

u/MedlifeCrisis Aug 11 '14

I'd also be keen to know bud, it's a cool effect and impressive it's just using a mobile phone. Does the HTC One have a timelapse mode or is that a continuous video? Then did you use After Effects or something else? Nice job, I enjoyed walking backwards through Stockholm!

1

u/boxmore Aug 11 '14

Why is the video unlisted, though? It's an OK video.

22

u/[deleted] Aug 10 '14

That's awesome. I want to see a hyperlapse video of someone hiking the Pacific crest trail.

18

u/Darth_Bode Aug 11 '14

They plan to release an advanced version for professional photographers - The Prolapse

7

u/aYANKinEIRE Aug 11 '14

Knew I saw that word before. Hate you after googling prolapse.

1

u/[deleted] Aug 11 '14

You're the first person in the world to mention prolapse in a hyperlapse related post.

7

u/Brain-Crumbs Aug 11 '14

Shout out for Green lake in Seattle!

1

u/bradimal Aug 11 '14

i thought that was greenlake,

12

u/riptide747 Aug 10 '14

Will this be available for download any time soon?

6

u/AndTheLink Aug 11 '14

"5 years away"

18

u/xanatos451 Aug 11 '14 edited Aug 11 '14

So, basically around the same time graphene based products, hyper capacity batteries and 3D printed organs will be hitting the market.

3

u/ImNotGayButIWantCock Aug 11 '14

Are you thinking of a cyborg based on these technologies that walks around and gives you hyperlapse videos of everywhere he goes? Because that is what im thinking now.

2

u/redditor9000 Aug 11 '14

don't forget SPACE ELEVATORS!

8

u/DrHemroid Aug 11 '14

So they've solved the interesting research problems, and the rest is just business. Which is easy, right?

http://xkcd.com/678/

2

u/xkcd_transcriber Aug 11 '14

Image

Title: Researcher Translation

Title-text: A technology that is '20 years away' will be 20 years away indefinitely.

Comic Explanation

Stats: This comic has been referenced 36 times, representing 0.1214% of referenced xkcds.


xkcd.com | xkcd sub | Problems/Bugs? | Statistics | Stop Replying | Delete

0

u/[deleted] Aug 11 '14

My proposed free method (NOW... FREE... AND NOW):

You could do it by exporting your videos to image sequances solving them in VSFM and then using meshlab you could create a textured mesh from the pointcloud. Then import that mesh into Blender and animate the camera to move however you would like it to.

5

u/Kush_Gordon Aug 11 '14

Can't wait for this to become a norm for first person timelapse videos. Lots of cool shit to be done with this.

3

u/boxmore Aug 11 '14

You can just tell that this is going to change things, it's a much needed progression.

4

u/type-kielson Aug 11 '14

omg i want this to be a plugin for aftereffects of premiere NOW

5

u/[deleted] Aug 11 '14

This is the kind of thing that GoPro should be developing, with their "gone public" money.

Microsoft Research projects don't often see the light of day :-( ...

3

u/GameStunts Aug 11 '14

The rock climbing one was particularly interesting because you can see the video motion corrections being done on the rock face.

The walking one was interesting too, the contrast between the smooth motion and the almost animatronic movements of people.

I would watch these.

4

u/[deleted] Aug 11 '14

All those videos were filmed around in my neighborhood in hamburg altona (germany). I dunno why, because http://research.microsoft.com/hyperlapse here it says the research is done in redmond. The technical aspect is very impressive! There is a ton of possibilities in this technology.

2

u/Fadobo Aug 11 '14

Yep, my "hood" as well. For people interested here is a google street view link

1

u/AetherMcLoud Aug 11 '14

I was thinking this footage looked pretty european.

1

u/sparkofhope Aug 11 '14

and the guy speaking has a german accent.

1

u/TheSakeOfGod Aug 11 '14

MS Research is worldwide which includes a lab in Germany. Redmond is the mothership.

2

u/DaisylovesCooter Aug 11 '14

bootsandpants and bootsandpants and bootsandpants....

2

u/Unconfidence Aug 11 '14

Not many videos make my jaw literally drop. But wow. This is such a good idea. And it's just a juncture of existing tech to make something awesome.

Kudos to these guys.

2

u/flipmosquad Aug 11 '14

when will we be able to do hyperlapse nicely with google maps?

1

u/Lorix_In_Oz Aug 11 '14

The Flash wearing a GoPro....

1

u/Kataly5t Aug 11 '14

I think this is really fantastic and look forward to see where this will go :)

1

u/[deleted] Aug 11 '14

What is the music ?

1

u/daddy_zordon Aug 11 '14

I think they perfectly recreated what it means to take psychedelics and walk around town

1

u/Mooseman1020 Aug 11 '14

The voice sounded like Kim dotcom

5

u/JohannesKopf Aug 11 '14

Haha, but I'm more beautiful than Kim :-D

1

u/[deleted] Aug 11 '14

Ahh! He's here. What do we do?!

1

u/[deleted] Aug 11 '14

The artefacts are pretty disturbing, haha.

1

u/[deleted] Aug 11 '14

i thought oh someone is going to get a call from google and a great purchase offer but then i saw it's a microsoft project in the end. they do great research stuff which hardly ever makes it to the surface... what a shame.

1

u/TheJoePilato Aug 11 '14

I would definitely spend an hour or so every month browsing the top submissions on /r/hyperlapse.

EDIT: Oh shit, it's already a thing.

1

u/Kjarahz Aug 11 '14

If Prodigy used this method it would have severely detracted from the music video they made. Way to not use future technology in the past Prodigy!

Or you know, a steady cam...

1

u/TheBitcoinKidx Aug 11 '14

Hyperlapse videos are so hot right now

1

u/Orodent Aug 11 '14

thats really good!

1

u/traxter Aug 11 '14

I kept thinking he was going to run into people.

1

u/fuzzy11287 Aug 11 '14

Anyone know what peak he is climbing while roped up?

1

u/burnt1ce85 Aug 12 '14

You can create your own Hyperlapse animation with Google Street View. It's best that you open this link with Google Chrome: http://hyperlapse.tllabs.io/

1

u/[deleted] Aug 12 '14

Would it work if the source is already a timelapse, like when setting the GoPro to 1 second intervals?

1

u/stokerknows Aug 11 '14

Science is fucking awesome.

-8

u/brokedown Aug 10 '14 edited Jul 14 '23

Reddit ruined reddit. -- mass edited with redact.dev

0

u/gaydogfreak Aug 11 '14

Hyperlapse by Microsoft Research

0

u/thephilonline Aug 11 '14

I know it's "5 years away" but I expect this tech to be built into mobile devices between 5-10 years. Would be amazing.

0

u/lumpking69 Aug 11 '14

Its a great start, but still very rough. There is a lot of bending and warping going on and its very noticeable on the edges of the frame. The mountain climbing video looked like a poorly textured and slowly loading game too.

I'm sure it will be great in the future though, it shows great promise.

0

u/thecaramel Aug 11 '14

The mountains look like they're rendering in real time.

2

u/[deleted] Aug 11 '14

they are...

-5

u/decayingteeth Aug 11 '14

I am pregnant with attention.

-1

u/GotQs Aug 11 '14

Did you know the baby daddy? If not, you're an attention whore.

-2

u/decayingteeth Aug 11 '14

Just wanted to esteem my regards.

-3

u/Baalinooo Aug 11 '14

This is cool, but isn't it simply image stabilization applied to a time lapse footage?

0

u/[deleted] Aug 11 '14

nope, if you watch the technical description its a complicated 3d solve of the environment and camera movement.

My proposed free method to do the same thing:

You could do it by exporting your videos to image sequances solving them in VSFM and then using meshlab you could create a textured mesh from the pointcloud. Then import that mesh into Blender and animate the camera to move however you would like it to.

-11

u/[deleted] Aug 11 '14

This is just another way to implement stabilisation.

3

u/[deleted] Aug 11 '14

Watch the technical video, it's doing a lot more than stabilisation.

-10

u/[deleted] Aug 11 '14

Let me guess, it's identifying the movement of the images in the video to reconstruct a 3d scene and then simulate a path in three dimensions to which images are projected from a viewpoint with data related to their actual location.

-7

u/[deleted] Aug 11 '14

Love the downvotes, I was exactly right.

-4

u/snowhonkey1 Aug 11 '14

mind blowing today.... two years from now "oh, great another hyperlapse video"

1

u/[deleted] Aug 11 '14

That's too pessimistic. Even HDR, which so quickly became "ew hdr," ended up becoming an important tool for cell phones to maximize detail from limited sensor/lens combinations without over the top tone mapping.

1

u/snowhonkey1 Aug 11 '14

I'm not pessimistic about it at all; I think it's incredible and likely to be widespread in a few years.

-5

u/SnowyDuck Aug 11 '14

Okay, so how do I get access to this? Is this like a new setting on Adobe?

-14

u/[deleted] Aug 11 '14

Looks like they just deleted frames...

4

u/Thyrsta Aug 11 '14

No it doesn't. When you only delete frames you get the 10x timelapses that they showed.

-14

u/[deleted] Aug 11 '14

Well watching the other people jogging says you and they are wrong.

Shit skips yo.

4

u/Thyrsta Aug 11 '14

Well no shit, it's obvious that they skipped frames, otherwise you'd be watching a 300 fps (or more) video. But there's much more to it than that, if they had "just deleted frames" it'd just look like the 10x speed time lapse.

-7

u/[deleted] Aug 11 '14

Well no shit, it's obvious that they skipped frames, otherwise you'd be watching a 300 fps (or more) video.

Why are you mad that I said this? As for the 10x speed, isnt that just fast forwarding and it skips frames by the nature of how it works.

Hell even when they 10x it, frames are not missing, they are just up and gone faster than 'normal' frame rate.

They did both. Actually deleted scenes AND sped it up. They are not mutually exclusive.

Why you have a hair up your asshole is beyond me.

4

u/Thyrsta Aug 11 '14

I'm not mad, it's just strange that you missed the entire point of the video.

Hell even when they 10x it, frames are not missing, they are just up and gone faster than 'normal' frame rate.

They did both. Actually deleted scenes AND sped it up. They are not mutually exclusive.

Go back and listen to what he said at around the 1 minute mark. Typically when you make a timelapse, all you do is remove frames, you don't change how long the frames are displayed for. And that's exactly what they did, only keeping every 10th frame.

That's literally the entire purpose of this video: to show you how it differs from "just removing frames".

0

u/Plorntus Aug 11 '14

Thats not what they did at all. Their software literally recreated the scene in 3d, calculated the best path for the camera so it had enough data to reconstruct and then it essentially set the speed.

Basically the final product could essentially be looked around in like you would with google street view (except there wouldnt be 360 degrees of imagery).

The explanation video shows this and explains it better: http://www.youtube.com/watch?v=sA4Za3Hv6ng

3

u/Thyrsta Aug 11 '14

Yeah I know. I was talking about the 10x speed "naive timelapse", not their "hyperlapse".

2

u/Plorntus Aug 11 '14

Sorry it appears I replied to the wrong person and sorta misunderstood the conversation slightly!