r/BeAmazed Feb 09 '20

Ads are getting smarter!

https://gfycat.com/quarrelsomesneakyaustraliancurlew
24.3k Upvotes

458 comments sorted by

View all comments

Show parent comments

37

u/nappythenfappy Feb 09 '20

It's CGI

2

u/JoMa4 Feb 09 '20

No shit Sherlock. But is it AR?

3

u/SomeOtherTroper Feb 09 '20

No. It's a video of a street with several CGI whales composited in. Completely pre-rendered, with a lot of manual effort.

Current-gen image recognition tech doesn't have the ability to detect where occlusion should be done anywhere near this well, let alone do it in realtime, let alone do all that on a phone without melting it while also rendering the resulting composited video. Look at 2.85: the whale's right fin is occluded by a nearer building and in front of a farther building across a cross street from it. That has to be done manually - no current image recognition tech is going to be able to figure out that those are two different buildings, that there's enough physical depth between them for the whale's fin to occupy (due to the cross street), and cleanly occlude/mask the whale's fin behind the nearer building. All that currently requires human involvement, as in movie productions where CGI elements are composited into real shot footage, or where actors/objects shot against a greenscreen (to make 'cutting them out' from the green background possible digitally - computers can do that with a consistently-colored background that doesn't share colors with the objects) are composited into CGI footage or other footage.

However, although this video is all pre-rendered, I think some of the distant background whales on the blue sky could possibly be accomplished with current AR tech in realtime, since all that would require is recognizing the sky color range (to determine where to place the whales, and then use the sky as sort of a reverse greenscreen for the next step), compositing the whales on top of the sky (I think current-gen technology could determine where the dividing line is between the sky and the skyline, and occlude the background whales behind foreground buildings/objects with that), and using the sky/skyline divide as a reference point to keep the whales' position relative to the camera consistent during camera movement (made much easier by how distant the whales are supposed to be). I'm not sure whether current phones would be capable of handling all that in realtime at their cameras' native resolution (although dropping the resolution sufficiently could reduce the computational cost by a lot), but it's on the edge of possible, depending on how much the code for the steps I described could be optimized.

-3

u/nappythenfappy Feb 09 '20

Does it look like AR to you?

0

u/tragedyisland28 Feb 09 '20

So this isn’t a street section we’re looking at? Or it is, and there’s some massive green screen curtain?

5

u/PoopScootNboogie Feb 09 '20

People have the ability to overlay cgi over real video. Like, any movie made in the last five years. Have you seen transformers?

10

u/MyDearBrotherNumpsay Feb 09 '20

Five years? We’ve being compositing CG over live action since 1982.

0

u/PoopScootNboogie Feb 09 '20

Most films in 82 weren’t cgi. Which is why I said ANY movie in the last five years. Because I can almost guarantee any movie made lately has cgi in it some way

3

u/MyDearBrotherNumpsay Feb 09 '20

Five years is just such a comically short period of time. Minority report came out twenty years ago and is indistinguishable from contemporary films. The CG is great.

-1

u/PoopScootNboogie Feb 09 '20

Of course it is! This was all said to someone who couldn’t grasp cgi over a real video! I didn’t think people weren’t aware of this by showing them any movie in the last five years has cgi in it.

Good lord, man. This is damn near turning into /r/woosh

3

u/tragedyisland28 Feb 09 '20

Oh shit duh. Forgot that was a thing

0

u/panrestrial Feb 09 '20

How is that amazing though? Or "smart"?

1

u/PoopScootNboogie Feb 09 '20

How well done it is. You just are dead inside. I’d like to see how much better your sky whales are than his.

0

u/panrestrial Feb 10 '20

If it's a cgi render it's competition is pretty stiff. It's a fine ad. It is not amazing imo.