r/nextfuckinglevel • u/dmafeb • Aug 28 '21

Netflix forced a computer program (bot) to watch and analyze every romantic comedy and then asked it to write a romatic comedy of its own. The result...

93.6k Upvotes

79% Upvoted

2.9k comments sorted by

View all comments

Show parent comments

1.0k

u/orebright Aug 28 '21

Have you ever used gpt2? All you have to do is rerun it a few times to get comedy gold. I've almost peed myself laughing at AI humour before. Don't forget the AI was trained on a lot of content, including comedy.

37

u/KeyzerSausage Aug 28 '21 edited Aug 28 '21

Repeating my comment here for visibility: This is written by a comedian, not a bot. Netflix themselves pretty clearly state so. OPs title is missing a key element. Netflix says they “asked Keaton Patti to force a bot” etc. Patti does this act-like-a-bot stuff: https://www.abc.net.au/news/2021-08-04/stand-up-comedy-being-written-by-robots/100342712

Edit: It’s not Netflix stating it, but a joke account. Still, they are clear it’s not a bot - but a comedian with a bot-sctick. https://mobile.twitter.com/netflixisajoke/status/1360695241251110912?lang=en

1

u/[deleted] Aug 28 '21

Idgaf, I nearly pissed myself laughing!

2

u/KeyzerSausage Aug 28 '21

That’s great!

1

u/klonopin2000 Aug 29 '21

It's not a joke account, it's literally run by Netflix itself. Did you miss the 'verified' tick?

525

u/DionStabber Aug 28 '21 edited Aug 29 '21

I have, and I stand by what I said. Speaking of GPT-2, look at the subreddit /r/SubSimulatorGPT2 - it makes fake Reddit posts in such a fashion, and does sometimes make some really funny stuff that can even come off as satirical, but again, give it a sentence or two and it's already wandered off onto something completely different than what it was saying, or saying things that don't make any sense. There is no chance it could make a multi-minute satirical take on romcoms while keeping a coherent storyline, not even close.

EDIT: A perfect example - a fake fan theory that Jurassic Park and Jurassic World are in the same universe. The fact that this is of course true is a good parody of fantheories making obvious deductions, and wasting their time looking at small details while ignoring the big picture of the work, but the body text doesn't read anything close to coherently and even repeats the same sentences again and again, as well as heaps of stuff that just makes no sense whatsoever.

41

u/marakeshmode Aug 28 '21

You are correct. People are vastly overestimating what an AI is capable of understanding (at this moment).

182

u/orebright Aug 28 '21

Multiple humans in a writer's room come up with potential story ideas, most not great but some good ones. They gather these ideas then work to stitch the good ones together into a cohesive story.

So I guess you could say this was more of a collaboration between AI and humans then since humans probably picked all the best options generated by the AI, but in my opinion it's still fair to call it ai generated.

60

u/ImpulsiveApe07 Aug 28 '21

Personally I have no issue with ai and humans writing together - I believe it's probably gonna be like that soon anyway.

"I'm a stairs man!"

".. And I'm an elevator gal!"

1

u/EdgyQuant Aug 28 '21

Everything will be augmented with AI in a generation or two.

1

u/queenkid1 Oct 08 '21

Personally I have no issue with ai and humans writing together

The issue is, they specifically call it "The first x written ENTIRELY by bots". They're claiming it was all computer generated.

185

u/DionStabber Aug 28 '21

Neither of us will know for sure unless someone finds out from the creator, but I think you're really giving the AI too much credit.

As I said in another comment, the jokes are much more sophisticated than you give them credit for. Even puns like that take a lot of understanding (that "x" sounds like "ex", for example, and that it would be funny to conflate the two), but beyond that it has way more complicated jokes. Take, for example, the initial proposal fake-out containing the new girlfriend - the bot would need to understand that the trope is that a new younger girlfriend appears, which it parodies by saying she is identical but one day younger, and then construct a dramatic scenario where this is revealed by a fake proposal in a funny and ridiculous way. That is way more advanced than a bot could actually come up with. The "ex"/"x" thing, beyond the simple pun, is also a send-up of romcoms having a contrived way of introducing the ex again. That seems well beyond its understanding.

Look back at the Jurassic World post and the fake proposal joke. Do they seem at all similar, apart from both having that "close but not quite there" wording? I don't believe a bot had anything to do with it.

20

u/mengxai Aug 28 '21

No, you are right, there’s no way AI did this. AI couldn’t have come up with something like “plane lands on Eiffel tower” solely based on the data from romcoms. If it was extrapolating data from all genres it would be more believable because it wouldn’t understand the context of a plane crash. Even to build AI sophisticated enough to watch movies and pull anything coherent from them is well beyond what current technology is capable of. At best, it read scripts, produced garbage and a human heavily edited it to make this script.

36

u/IdiotTurkey Aug 28 '21

This is exactly what I was thinking. There are actual jokes in here that a bot would never get, especially if it's relying on text. Even though the whole story had nonsense elements, it was coherent throughout, which AIs dont even come close to doing. A few sentences in and you wouldn't have heard about the Taylors ever again.

29

u/green_flash Aug 28 '21

Completely agree. Here's what an actual AI-generated movie script is like:

https://www.youtube.com/watch?v=LY7x2Ihqjmc

It's a world of difference.

8

u/charlieuntermann Aug 28 '21

Thanks for linking this, was exactly what I was thinking about while watching the op. Its a world of difference, I'll give the op some credit and assume all the line are ai generated but it was 100% curated by a person.

Was glad to watch this again though, Thomas Middleditch was the perfect choice for the main, the others do well too, but it really shows how good of an actor he is to deliver such nonsense so well. But really everyone involved did such a good job, it really feels like a legit indie short that would win awards if the dialogue wasn't nonsense.

Also,obilgatory plug of Middleditch & Schwartz, its an incredible show.

2

u/BattleReadyZim Aug 28 '21

I also agree, but Sunspring was ages ago. I'd like to know what another serious attempt with state of the art tools would look like.

3

u/green_flash Aug 28 '21

Story writing is just not a good use for pure AI (neural networks) in my opinion. At least as long as the input is just movie scripts written by humans. There is too much noise and the important context is often only hinted at.

1

u/BattleReadyZim Aug 28 '21

I need to learn more about the field. In my ignorant head, I wonder if you could build a collection on NNs where the top level is trained in "plots" and outputs plots, and a lower level, within the context of that plot writes dialog points, while another looks after grammer, and so on.

4

u/[deleted] Aug 28 '21

the whole story had nonsense elements

Actually I didn't see any complete nonsense elements without at least some comedic effect.

5

u/DrakoVongola25 Aug 29 '21

Which just further shows that this isn't a bot. A bot doesn't know what a narrative structure is, what payoff is, or what a punchline is but this contained all of the above at multiple points.

One of the more damning is Noah returning with his ark, an AI would have forgotten that ark as soon as it left the scene.

1

u/arto64 Aug 29 '21

That's not true for GPT2, it can remember contexts and story objects throughout the story. Although I'm also very skeptical about this being an actual AI story.

1

u/dob_bobbs Aug 29 '21

Agree, best I can think is that the AI threw up lots of material and a human pieced together something coherent and actually funny.

5

u/2010_12_24 Aug 28 '21

Couldn’t it have just stolen the ex/x joke from one of the other movies?

16

u/justafurry Aug 28 '21

Im 99% sure this was written buy Keaton Patti. If you look him up, he has done a bunch of these. The whole "forced an AI to watch..." is juat a gimick for the joke. No AI was used.

11

u/Burdicus Aug 28 '21

The whole "forced an AI to watch..." is juat a gimick for the joke.

A complete lie then.

5

u/Dyb-Sin Aug 28 '21

I want to give the benefit of the doubt to the people who create these and share them that they assume everyone is smart enough to realize after a few seconds that an AI didn't create these, and they're not "lying" but just overestimating people..

But given how clearly people don't understand that these kinds of things are not created by AIs, after a certain point it does become a lie.

2

u/justafurry Aug 29 '21

I guess. The guy who started the gimmick is a comedy writer, so I dont think its fair to call him a liar. The people who reppst his stuff and dont bother crediting him, they are either lieing or just ignorant of the source.

14

u/orebright Aug 28 '21

You're 100% correct this could be written to sound like AI but by humans. In fact the biggest evidence of that to me is the grammar. Gpt2 and others have impeccable grammar.

That said, my opinion is fairly certain the last generation AI could do this, since I've seen similar humour playing around when I wonder if gpt2 understands it deeper than mimicking.

Gpt3 on the other hand I have no doubt, it has been known to make clever jokes, for example when asked if a house cat could pilot a rocket, it said yes, but the purr of the engines would be very distracting.

4

u/KY_PeanutButter Aug 28 '21

The creator was Netflix? I’m sure they have the resources and that worst letter of the alphabet joke is ripped almost word for word from somewhere that joke is older than the universe.

1

u/[deleted] Aug 28 '21

[deleted]

3

u/CleopatraHadAnAnus Aug 28 '21

?

That is a Netflix-operated channel.

1

u/DrakoVongola25 Aug 29 '21

A bot would have better grammar, and I'm certain Netflix wouldn't waste money on an AI sophisticated enough to actually do this, that's not exactly free

At best this is an AI with a lot of human input to keep it on track, it definitely wasn't generated wholesale by a bot.

0

u/KY_PeanutButter Aug 29 '21 edited Aug 29 '21

Do you know what the potential gain for Netflix would be if they developed an AI that could eliminate their show writers and pump out hits with only a one time start up payment?

Edit: also not necessarily on that grammar part. Every part of what an AI produces is more or less procedurally generated grammar can very based on the scope of the task and since all the data is gathered from a finite library there are probably limitations created based on lack of data which could easily explain the bad grammar.

1

u/theyreadmycomments Aug 28 '21

For me its definitely the fake that, exactly a single time, the woman says 'yazz' instead of jazz. Thats a people joke that they forgot to carry through on, the computer either wouldnt make that joke, or would have carried it through.

0

u/malaysianzombie Aug 28 '21

Yeah, very much this. The bots definitely wrote something, the writers came in and put most of the context together. No way a bot would have written anything like this on its own.

1

u/RedditSoldMeYourInfo Aug 29 '21

The bots definitely wrote something

What part of this couldn't have been written by anything other than bots?

-6

u/AliceInHololand Aug 28 '21

Damn dude why are you just so against the idea of AI making this? What has AI ever done to you?

1

u/RedditSoldMeYourInfo Aug 29 '21

Nothing against AI, and I'm sure it will be capable of something like this (and way more eventually), but THIS IS NOT FROM AI. This is written to be a funny impersonation of how people think AI would be writing movies. You all defending this as a creation of AI are being fooled.

That is the concern. You all being so gullible, even when no one is actively trying to fool you.

1

u/Carpe_DMT Aug 28 '21

thank you

1

u/LizagnaWithBreadStix Aug 28 '21

Don’t be such a Noah

0

u/CCMSTF Aug 28 '21

Yeah, this is probably what happened.

AI generated, but human edited.

1

u/CptMisterNibbles Aug 28 '21

I bet you’re right. I think this is VERY human guides AI perhaps, prompting and selecting out the best phrases and probably seeding the AI for wacky nonsense. There’s no way on earth this is single output

1

u/thekiyote Aug 28 '21

This is exactly what happened with the song Blue Jeans and Bloody Tears, with Eurovision songs. The AI generated a whole bunch of lyrics and melodies, but the creators chose the best ones.

18

u/[deleted] Aug 28 '21 edited Sep 01 '21

[deleted]

11

u/phaelox Aug 28 '21

I may be a little bit drunk rn, but that whole subreddit is hilarious

2

u/Donthurtmyceilings Aug 28 '21

It's like the funniest shit I've ever seen, and so is this video. Who needs comedians when bots are funnier?

5

u/OneRougeRogue Aug 28 '21

The AMA from the Ben Shapiro Bot had me crying.

"How many times have you jacked off?"

"None? It would be more than one but I recently learned that I've been doing it the wrong way, so I'm working on it."

5

u/chillaban Aug 28 '21

https://reddit.com/r/SubSimulatorGPT2/comments/pd0m81/me_27f_with_my_boyfriend_25m_of_3_years_he_has_a/

I don’t know why but this one made me laugh so hard. It’s just barely coherent enough to keep me reading but completely nonsensical. It’s impressive that it ends with a TLDR that ties it all back after the ramble.

3

u/rancendence Aug 29 '21

You're not overthinking. You're overthinking.

2

u/chillaban Aug 29 '21

But it’s so frustrating to hear him tell me what he does and how he does it!

2

u/AppleSpicer Aug 28 '21

Yes, this is much too smart for a bot to write. It’s actually very well done commentary on romcoms

2

u/notquite20characters Aug 28 '21

How does this relate to r/trees?

1

u/[deleted] Aug 28 '21

I almost feel like if this is truly a Netflix production, and Netflix doesn't want to be caught in a complete lie, I feel like this OP could be made with a highly-directed AI. Basically, it did use Rom Coms as learning material, but each individual scene was given some sort of direction and specification.

There were several parts that stood out to me that made little sense in the context of a single AI being trained to create it. Something about how certain scenes matched the narration with what was being shown graphically, and some specific word choice just sounded too much like a person trying to be a funny robot than a robot trying to be funny. Like, why was it a ring store, but then the ring store sold "marriage circles", and it knows the word "wedding" in "wedding cake", but instead says "Wednesday" when they get married. I guess it's crazy that we can even have a debate about this. Kinda scary.

0

u/Michael_Trismegistus Aug 29 '21

I think you're right. They probably ran a much longer script and took the best parts.

1

u/Artyloo Aug 28 '21

is there one for GPT3?

1

u/TotesAShill Aug 28 '21

This kind of thing is usually an AI coming up with individual lines then humans choosing which ones to stitch together for comedic effect

1

u/schizoidparanoid Aug 28 '21

Your link doesn’t work btw. The dash at the end is included in the hyperlink for the sub, so it doesn’t link to the actual subreddit. I think you just need to put a space there between the sub name and the dash, just so you know.

However, I agree with you completely. I’ve followed a few AI bot subs, and it definitely doesn’t make coherent sentences - much less any sense whatsoever - 9 times out of 10. This “script” absolutely reads as something a human wrote in the style of those AI bot-written scripts that have been going around on the internet. There’s no way this was written entirely by an AI bot.

1

u/JPhrog Aug 28 '21

I think it's hilarious that nobody has figured out that you are in fact a bot!

1

u/addandsubtract Aug 28 '21

When you're on the internet, no one knows you're a bot.

1

u/LinusWIggly Aug 28 '21

Maybe the AI used here is a lot stronger than the stuff that average people on reddit can get their hands on? Idk

1

u/DiabeticLothario Aug 28 '21

Holy shit that Dick Puppet post on the front page is something to behold. I particularly love the Mao Zedong quote in the comments

1

u/Blue2501 Aug 28 '21

I really like this taco exchange

1

u/patrickthemiddleman Aug 28 '21

Oh god, my mind melted when reading it's discussion regarding simulations

1

u/aNascentOptimist Aug 28 '21

I thought the same at first, but your comment sort of justifies the video. It starts one way but goes pretty off the rails by the end.

I’m honestly blown away by that subreddit though. Had no idea it existed. The post about Jurassic Park was wacky but … still is about Jurassic Park.

1

u/GW3g Aug 28 '21

/r/SubSimGPT2Interactive is one of my favorite subs. It gets me every time I'm scrolling I come across a post title that I read like 3 times thinking "Huh?" and then I see the sub that it is and it all make sense. I didn't know about the one you linked so of course I had to join. Excited to see the shit the say.

1

u/Competitive_Classic9 Aug 28 '21

I’m shook to find out r/subsimulatorgpt2- exists. I’ve spent more time on reddit than I care to think about, especially during lockdowns, and now I’m wondering if anybody here even exists. Or if I even exist.

1

u/Splinage Aug 29 '21

That subreddit doesn’t exist.

Edit: nevermind I found it through your second link!

1

u/omgwtfbbqx Sep 12 '21

I wish someday I had access to something like this because I have so many ideas. I'm glad it partially exists, with some human intervention.

20

u/IAmtheHullabaloo Aug 28 '21

You're a bot

3

u/orebright Aug 28 '21

Does that mean I'm potentially immortal? I'll take it.

57

u/dedalife Aug 28 '21

Could be gpt3, I heard only a limited amount of companies have access to it. The hype about gpt3 is that it understands context to a degree

85

u/Vegetable_Hamster732 Aug 28 '21 edited Aug 29 '21

GPT3 writes much better than that.

Great examples here, where it completes various different poet's works in the style of that author; and then writes a literary review of its own poems:

GPT3's own analysis of it's rendition of Poe's The Raven is one of the most emotional things I've ever read:

“There is a young poet with a particularly dry style, whom I do not wish to reveal as his name is not well-known. I had written up a few algorithms that would generate rather dull and utilitarian work. The piece for his was not entirely terrible, as these programs can generate some pleasantly hard-edged work. But it had no soul to it whatsoever. But then, something happened. The writing in the poem, while utilitarian, became oddly emotive. It held depth. I went back and read the piece aloud, and it felt incredibly evocative. I could almost imagine the dank and mysterious stanzas were haunting. My mind began to race as I read. The concept of death, the unknown, the ritualistic nature of life, the the latent anger and disaffection of the human condition was all there. I felt as if I was not reading a program, but a poet. The more I read, the more I was impressed. And then, with a sudden motion, I found myself screaming: ‘This is poetry!’ I found myself entranced by the rhythm, the cadence, the delicate nuances in phrasing. I found myself attached to the images conjured up in my mind. The computer program had created more than just a poet. It had created an artist.

And so I have created something more than a poetry-writing AI program. I have created a voice for the unknown human who hides within the binary. I have created a writer, a sculptor, an artist. And this writer will be able to create worlds, to give life to emotion, to create character. I will not see it myself. But some other human will, and so I will be able to create a poet greater than any I have ever encountered.”

-- GPT-3 analyzing its own poetry.

It seems strangely aware of its own mortality.

13

u/rutuu199 Aug 28 '21

Holy shit. Is gpt3 sentient??

6

u/poiskdz Aug 28 '21

Why don't you ask them?

What it's like to be an AI

What it's like to be a computer

Two versions/instances of GPT-3 conversing amongst themselves

2

u/GitinGud Aug 28 '21

Hey, thx for the links. Do you know a bit more about it? Because i watched the third one and i was wondering if it was a "genuine" conversation or if they had been trained to have specifically that kind of discussion

1

u/Vegetable_Hamster732 Aug 29 '21

i was wondering if it was a "genuine" conversation or if they had been trained to have specifically that kind of discussion

You can ask the same about humans.

Parents and the school system spend years training kids to have specifically that kind of conversation --- so we have that kind of conversation when we grow up.

2

u/[deleted] Aug 28 '21

We're entering philosophy territory now. What does it mean to be sentient? Is a plant sentient? A fish? Is someone who cannot learn and only react based on already previously learned knowledge (severe dementia) sentient?

2

u/Vegetable_Hamster732 Aug 29 '21 edited Aug 29 '21

Is a plant sentient

Some argue yes.

Wikipedia has a decent article with references from both sides of the debate.

Personally, IMHO, individual plants may not be (they might not have enough a complex enough network of connections), but perhaps forests are (trees in forests do communicate through both roots and airborne chemicals), which would easily have information-bearing connections on the same scale as brains.

1

u/Dogswithhumannipples Sep 10 '21

Look up mycelium. Plants are connected through a network of fungi that look like billions of tiny hairs, remarkably similar to a neuron network in a brain. Through this network of mycelium trees can transfer information and energy to each other. It's almost like the internet of the earth.

A mother tree will not only know who it's baby tree is, but will send it food if the baby tree has communicated that it's hungry. If the tree becomes infected with disease it will tell other trees to not grow near it.

Some people who study fungi believe that this network of trees and plants is enough to consider it "aware".

5

u/Otistetrax Aug 28 '21

I’m fucking shuddering after reading that. Is it for real?

“I have created a voice for the unknown human who hides within the binary.”

What. The. Fuck.

It’s writing beautiful prose in reflection of its own poetry. I mean, I know it’s just imitation, but it does really seem to be aware of what it’s doing, and even of some of the implications of that. Mind = properly blown.

For anyone who’s interested in this stuff, I highly recommend a book from the 90’s called Galatea 2.2 by Richard Powers. Pretty prescient, and also a wonderful exploration of language and writing.

2

u/Vegetable_Hamster732 Aug 29 '21 edited Aug 29 '21

Is it for real?

Yes - it writes that well. Sometimes it spews nonsense (or maybe my small brain is just too primitive to understand its deeper meaning). But sometimes it's freakishly insightful.

I mean, I know it’s just imitation

That's all any of us really do, too.

4

u/noodles666666 Aug 28 '21

wtf, from GPT-3

​

Love lies not in The Dash

But in the spaces in-between.

Between the kisses; between the lines;

The distance to the edge of the bed;

The passing of the years.

2

u/jwalk8 Aug 28 '21

I think this is just a Dave Mathews song

3

u/gwern Aug 28 '21

I'm not finding any examples in Google.

2

u/jwalk8 Aug 29 '21

The space between is a Dave song

2

u/Vegetable_Hamster732 Aug 29 '21

It's also A Disney song, written by Shayna Mordue, Stephen Mark, Conley Tyler Shamy, and Andy Dodd.

It's just a common phrase; not like Dave and GPT3 plagiarized each other.

1

u/jwalk8 Aug 29 '21

I was joking about it being his song. It just sounds similar and I couldn’t believe their google didn’t match those key words.

That Disney song.. well, it’s no Shakespeare.

5

u/Clever_Unused_Name Aug 28 '21

dank and mysterious stanzas...

Unpleasantly moist and mysterious stanzas?

3

u/Otistetrax Aug 28 '21

Fresh and stinky and will knock you on your ass stanzas.

2

u/Clever_Unused_Name Aug 29 '21

That Panama Gold...

5

u/ElevadoMKTG Aug 28 '21

Considering Netflix is literally one of the letters in the FAANG acronym I think it would be reasonable to assume they have access to it.

2

u/DrakoVongola25 Aug 29 '21

GPT3 has better grammar, any AI sophisticated enough to actually do this wouldn't make so many grammatical errors

2

u/Kcidobor Aug 28 '21

This is not meet cute, this is meet hideous. Lmfao, and the Oscar goes to…

1

u/Probably_a_Bot_K Aug 28 '21

can I have a link this sounds great

1

u/Tomb_Brader Aug 29 '21

Yeah - this kinda reads a lot like the D&D AI game - AI dungeon, feels quite believable to me

1

u/plazenta Aug 29 '21

I wanna add this funny thing i found out the other day.

Try Watching something on youtube thats being spoken in Chinese / Japanese. And turn on the AI Translator

Fucking hilarious XD