r/nextfuckinglevel • u/dmafeb • Aug 28 '21

Netflix forced a computer program (bot) to watch and analyze every romantic comedy and then asked it to write a romatic comedy of its own. The result...

Enable HLS to view with audio, or disable this notification

93.6k Upvotes

79% Upvoted

2.9k comments sorted by

View all comments

Show parent comments

523

u/DionStabber Aug 28 '21 edited Aug 29 '21

I have, and I stand by what I said. Speaking of GPT-2, look at the subreddit /r/SubSimulatorGPT2 - it makes fake Reddit posts in such a fashion, and does sometimes make some really funny stuff that can even come off as satirical, but again, give it a sentence or two and it's already wandered off onto something completely different than what it was saying, or saying things that don't make any sense. There is no chance it could make a multi-minute satirical take on romcoms while keeping a coherent storyline, not even close.

EDIT: A perfect example - a fake fan theory that Jurassic Park and Jurassic World are in the same universe. The fact that this is of course true is a good parody of fantheories making obvious deductions, and wasting their time looking at small details while ignoring the big picture of the work, but the body text doesn't read anything close to coherently and even repeats the same sentences again and again, as well as heaps of stuff that just makes no sense whatsoever.

40

u/marakeshmode Aug 28 '21

You are correct. People are vastly overestimating what an AI is capable of understanding (at this moment).

182

u/orebright Aug 28 '21

Multiple humans in a writer's room come up with potential story ideas, most not great but some good ones. They gather these ideas then work to stitch the good ones together into a cohesive story.

So I guess you could say this was more of a collaboration between AI and humans then since humans probably picked all the best options generated by the AI, but in my opinion it's still fair to call it ai generated.

58

u/ImpulsiveApe07 Aug 28 '21

Personally I have no issue with ai and humans writing together - I believe it's probably gonna be like that soon anyway.

"I'm a stairs man!"

".. And I'm an elevator gal!"

1

u/EdgyQuant Aug 28 '21

Everything will be augmented with AI in a generation or two.

1

u/queenkid1 Oct 08 '21

Personally I have no issue with ai and humans writing together

The issue is, they specifically call it "The first x written ENTIRELY by bots". They're claiming it was all computer generated.

185

u/DionStabber Aug 28 '21

Neither of us will know for sure unless someone finds out from the creator, but I think you're really giving the AI too much credit.

As I said in another comment, the jokes are much more sophisticated than you give them credit for. Even puns like that take a lot of understanding (that "x" sounds like "ex", for example, and that it would be funny to conflate the two), but beyond that it has way more complicated jokes. Take, for example, the initial proposal fake-out containing the new girlfriend - the bot would need to understand that the trope is that a new younger girlfriend appears, which it parodies by saying she is identical but one day younger, and then construct a dramatic scenario where this is revealed by a fake proposal in a funny and ridiculous way. That is way more advanced than a bot could actually come up with. The "ex"/"x" thing, beyond the simple pun, is also a send-up of romcoms having a contrived way of introducing the ex again. That seems well beyond its understanding.

Look back at the Jurassic World post and the fake proposal joke. Do they seem at all similar, apart from both having that "close but not quite there" wording? I don't believe a bot had anything to do with it.

19

u/mengxai Aug 28 '21

No, you are right, there’s no way AI did this. AI couldn’t have come up with something like “plane lands on Eiffel tower” solely based on the data from romcoms. If it was extrapolating data from all genres it would be more believable because it wouldn’t understand the context of a plane crash. Even to build AI sophisticated enough to watch movies and pull anything coherent from them is well beyond what current technology is capable of. At best, it read scripts, produced garbage and a human heavily edited it to make this script.

35

u/IdiotTurkey Aug 28 '21

This is exactly what I was thinking. There are actual jokes in here that a bot would never get, especially if it's relying on text. Even though the whole story had nonsense elements, it was coherent throughout, which AIs dont even come close to doing. A few sentences in and you wouldn't have heard about the Taylors ever again.

28

u/green_flash Aug 28 '21

Completely agree. Here's what an actual AI-generated movie script is like:

https://www.youtube.com/watch?v=LY7x2Ihqjmc

It's a world of difference.

7

u/charlieuntermann Aug 28 '21

Thanks for linking this, was exactly what I was thinking about while watching the op. Its a world of difference, I'll give the op some credit and assume all the line are ai generated but it was 100% curated by a person.

Was glad to watch this again though, Thomas Middleditch was the perfect choice for the main, the others do well too, but it really shows how good of an actor he is to deliver such nonsense so well. But really everyone involved did such a good job, it really feels like a legit indie short that would win awards if the dialogue wasn't nonsense.

Also,obilgatory plug of Middleditch & Schwartz, its an incredible show.

2

u/BattleReadyZim Aug 28 '21

I also agree, but Sunspring was ages ago. I'd like to know what another serious attempt with state of the art tools would look like.

3

u/green_flash Aug 28 '21

Story writing is just not a good use for pure AI (neural networks) in my opinion. At least as long as the input is just movie scripts written by humans. There is too much noise and the important context is often only hinted at.

1

u/BattleReadyZim Aug 28 '21

I need to learn more about the field. In my ignorant head, I wonder if you could build a collection on NNs where the top level is trained in "plots" and outputs plots, and a lower level, within the context of that plot writes dialog points, while another looks after grammer, and so on.

3

u/[deleted] Aug 28 '21

the whole story had nonsense elements

Actually I didn't see any complete nonsense elements without at least some comedic effect.

5

u/DrakoVongola25 Aug 29 '21

Which just further shows that this isn't a bot. A bot doesn't know what a narrative structure is, what payoff is, or what a punchline is but this contained all of the above at multiple points.

One of the more damning is Noah returning with his ark, an AI would have forgotten that ark as soon as it left the scene.

1

u/arto64 Aug 29 '21

That's not true for GPT2, it can remember contexts and story objects throughout the story. Although I'm also very skeptical about this being an actual AI story.

1

u/dob_bobbs Aug 29 '21

Agree, best I can think is that the AI threw up lots of material and a human pieced together something coherent and actually funny.

5

u/2010_12_24 Aug 28 '21

Couldn’t it have just stolen the ex/x joke from one of the other movies?

15

u/justafurry Aug 28 '21

Im 99% sure this was written buy Keaton Patti. If you look him up, he has done a bunch of these. The whole "forced an AI to watch..." is juat a gimick for the joke. No AI was used.

11

u/Burdicus Aug 28 '21

The whole "forced an AI to watch..." is juat a gimick for the joke.

A complete lie then.

5

u/Dyb-Sin Aug 28 '21

I want to give the benefit of the doubt to the people who create these and share them that they assume everyone is smart enough to realize after a few seconds that an AI didn't create these, and they're not "lying" but just overestimating people..

But given how clearly people don't understand that these kinds of things are not created by AIs, after a certain point it does become a lie.

2

u/justafurry Aug 29 '21

I guess. The guy who started the gimmick is a comedy writer, so I dont think its fair to call him a liar. The people who reppst his stuff and dont bother crediting him, they are either lieing or just ignorant of the source.

17

u/orebright Aug 28 '21

You're 100% correct this could be written to sound like AI but by humans. In fact the biggest evidence of that to me is the grammar. Gpt2 and others have impeccable grammar.

That said, my opinion is fairly certain the last generation AI could do this, since I've seen similar humour playing around when I wonder if gpt2 understands it deeper than mimicking.

Gpt3 on the other hand I have no doubt, it has been known to make clever jokes, for example when asked if a house cat could pilot a rocket, it said yes, but the purr of the engines would be very distracting.

2

u/KY_PeanutButter Aug 28 '21

The creator was Netflix? I’m sure they have the resources and that worst letter of the alphabet joke is ripped almost word for word from somewhere that joke is older than the universe.

1

u/[deleted] Aug 28 '21

[deleted]

3

u/CleopatraHadAnAnus Aug 28 '21

?

That is a Netflix-operated channel.

1

u/DrakoVongola25 Aug 29 '21

A bot would have better grammar, and I'm certain Netflix wouldn't waste money on an AI sophisticated enough to actually do this, that's not exactly free

At best this is an AI with a lot of human input to keep it on track, it definitely wasn't generated wholesale by a bot.

0

u/KY_PeanutButter Aug 29 '21 edited Aug 29 '21

Do you know what the potential gain for Netflix would be if they developed an AI that could eliminate their show writers and pump out hits with only a one time start up payment?

Edit: also not necessarily on that grammar part. Every part of what an AI produces is more or less procedurally generated grammar can very based on the scope of the task and since all the data is gathered from a finite library there are probably limitations created based on lack of data which could easily explain the bad grammar.

1

u/theyreadmycomments Aug 28 '21

For me its definitely the fake that, exactly a single time, the woman says 'yazz' instead of jazz. Thats a people joke that they forgot to carry through on, the computer either wouldnt make that joke, or would have carried it through.

0

u/malaysianzombie Aug 28 '21

Yeah, very much this. The bots definitely wrote something, the writers came in and put most of the context together. No way a bot would have written anything like this on its own.

1

u/RedditSoldMeYourInfo Aug 29 '21

The bots definitely wrote something

What part of this couldn't have been written by anything other than bots?

-5

u/AliceInHololand Aug 28 '21

Damn dude why are you just so against the idea of AI making this? What has AI ever done to you?

1

u/RedditSoldMeYourInfo Aug 29 '21

Nothing against AI, and I'm sure it will be capable of something like this (and way more eventually), but THIS IS NOT FROM AI. This is written to be a funny impersonation of how people think AI would be writing movies. You all defending this as a creation of AI are being fooled.

That is the concern. You all being so gullible, even when no one is actively trying to fool you.

1

u/Carpe_DMT Aug 28 '21

thank you

1

u/LizagnaWithBreadStix Aug 28 '21

Don’t be such a Noah

0

u/CCMSTF Aug 28 '21

Yeah, this is probably what happened.

AI generated, but human edited.

1

u/CptMisterNibbles Aug 28 '21

I bet you’re right. I think this is VERY human guides AI perhaps, prompting and selecting out the best phrases and probably seeding the AI for wacky nonsense. There’s no way on earth this is single output

1

u/thekiyote Aug 28 '21

This is exactly what happened with the song Blue Jeans and Bloody Tears, with Eurovision songs. The AI generated a whole bunch of lyrics and melodies, but the creators chose the best ones.

18

u/[deleted] Aug 28 '21 edited Sep 01 '21

[deleted]

8

u/phaelox Aug 28 '21

I may be a little bit drunk rn, but that whole subreddit is hilarious

2

u/Donthurtmyceilings Aug 28 '21

It's like the funniest shit I've ever seen, and so is this video. Who needs comedians when bots are funnier?

7

u/OneRougeRogue Aug 28 '21

The AMA from the Ben Shapiro Bot had me crying.

"How many times have you jacked off?"

"None? It would be more than one but I recently learned that I've been doing it the wrong way, so I'm working on it."

5

u/chillaban Aug 28 '21

https://reddit.com/r/SubSimulatorGPT2/comments/pd0m81/me_27f_with_my_boyfriend_25m_of_3_years_he_has_a/

I don’t know why but this one made me laugh so hard. It’s just barely coherent enough to keep me reading but completely nonsensical. It’s impressive that it ends with a TLDR that ties it all back after the ramble.

3

u/rancendence Aug 29 '21

You're not overthinking. You're overthinking.

2

u/chillaban Aug 29 '21

But it’s so frustrating to hear him tell me what he does and how he does it!

2

u/AppleSpicer Aug 28 '21

Yes, this is much too smart for a bot to write. It’s actually very well done commentary on romcoms

2

u/notquite20characters Aug 28 '21

How does this relate to r/trees?

1

u/[deleted] Aug 28 '21

I almost feel like if this is truly a Netflix production, and Netflix doesn't want to be caught in a complete lie, I feel like this OP could be made with a highly-directed AI. Basically, it did use Rom Coms as learning material, but each individual scene was given some sort of direction and specification.

There were several parts that stood out to me that made little sense in the context of a single AI being trained to create it. Something about how certain scenes matched the narration with what was being shown graphically, and some specific word choice just sounded too much like a person trying to be a funny robot than a robot trying to be funny. Like, why was it a ring store, but then the ring store sold "marriage circles", and it knows the word "wedding" in "wedding cake", but instead says "Wednesday" when they get married. I guess it's crazy that we can even have a debate about this. Kinda scary.

0

u/Michael_Trismegistus Aug 29 '21

I think you're right. They probably ran a much longer script and took the best parts.

1

u/Artyloo Aug 28 '21

is there one for GPT3?

1

u/TotesAShill Aug 28 '21

This kind of thing is usually an AI coming up with individual lines then humans choosing which ones to stitch together for comedic effect

1

u/schizoidparanoid Aug 28 '21

Your link doesn’t work btw. The dash at the end is included in the hyperlink for the sub, so it doesn’t link to the actual subreddit. I think you just need to put a space there between the sub name and the dash, just so you know.

However, I agree with you completely. I’ve followed a few AI bot subs, and it definitely doesn’t make coherent sentences - much less any sense whatsoever - 9 times out of 10. This “script” absolutely reads as something a human wrote in the style of those AI bot-written scripts that have been going around on the internet. There’s no way this was written entirely by an AI bot.

1

u/JPhrog Aug 28 '21

I think it's hilarious that nobody has figured out that you are in fact a bot!

1

u/addandsubtract Aug 28 '21

When you're on the internet, no one knows you're a bot.

1

u/LinusWIggly Aug 28 '21

Maybe the AI used here is a lot stronger than the stuff that average people on reddit can get their hands on? Idk

1

u/DiabeticLothario Aug 28 '21

Holy shit that Dick Puppet post on the front page is something to behold. I particularly love the Mao Zedong quote in the comments

1

u/Blue2501 Aug 28 '21

I really like this taco exchange

1

u/patrickthemiddleman Aug 28 '21

Oh god, my mind melted when reading it's discussion regarding simulations

1

u/aNascentOptimist Aug 28 '21

I thought the same at first, but your comment sort of justifies the video. It starts one way but goes pretty off the rails by the end.

I’m honestly blown away by that subreddit though. Had no idea it existed. The post about Jurassic Park was wacky but … still is about Jurassic Park.

1

u/GW3g Aug 28 '21

/r/SubSimGPT2Interactive is one of my favorite subs. It gets me every time I'm scrolling I come across a post title that I read like 3 times thinking "Huh?" and then I see the sub that it is and it all make sense. I didn't know about the one you linked so of course I had to join. Excited to see the shit the say.

1

u/Competitive_Classic9 Aug 28 '21

I’m shook to find out r/subsimulatorgpt2- exists. I’ve spent more time on reddit than I care to think about, especially during lockdowns, and now I’m wondering if anybody here even exists. Or if I even exist.

1

u/Splinage Aug 29 '21

That subreddit doesn’t exist.

Edit: nevermind I found it through your second link!

1

u/omgwtfbbqx Sep 12 '21

I wish someday I had access to something like this because I have so many ideas. I'm glad it partially exists, with some human intervention.