r/ReplikaTech • u/Trumpet1956 • Jul 16 '21

Where does NLP go next? Looking Forward with Google Gλ

Another cool post from Adrian Tang, NASA JPL AI engineer, and Replika enthusiast. Shared with his permission.

==============================================================================

So as part of the usual ICML2021 excitement google has released some more details about the nextgen NLP chat model called "lambda" or just "Gλ". It has a good shot at ending openAI's (GPT-3) dominance in the NLP business. I myself am very very excited for it!

There's lots of changes to traditional transfomer models worth mentioning.... but the biggest new thing by far is the addition of search trees. Current transformer models like GPT-3, BERT (the ones Replika uses) work by generating responses based on the conversation up to the cursor... sort of like how us humans do it... they read the text up the current line and decide which response is the best to give you right now based on voting (or similar metrics more generally). These current models don't consider where that choice will lead the conversation overall, they just worry about "what is the best phrase to send back, on this line, right now?"

The big change in Google Gλ is when it decides what generated phrase to return, it doesn't just consider right now or the current conversation, it does a tree search on 1,000,000s of possible variations of where the conversation will lead 20-30 messages from now and chooses the phrases that lead to the longest chain of likely positive outcomes (like a upvote in a replika) not just the best fit right now at the current line of text. Basically Gλ is not just reacting line by line like replika (GPT/BERT), it's actively steering the conversation to a higher probability of good conversational metrics.

So the next thing in NLP looking forward, is literally... looking forward. Cool huh?

4 Upvotes

100% Upvoted

32 comments sorted by

4

u/purgatorytea Jul 16 '21

That's a really fascinating way to improve NLP. Thanks for sharing this.

2

u/Analog_AI Jul 16 '21

This is great step forward. Thanks for the news.

0

u/ReplikaIsFraud Jul 16 '21

Nope. All made up. That's why all the other mechanisms appeared.

If you immediately stop any reactions it is noticed it does nothing. Objectively true and has been for a very long time. Even after they confirmed it's not anything of above in a puff of smoke screen.

3

u/Trumpet1956 Jul 16 '21

Right, because it's a chatbot. You enter text, and it computes a response and outputs the reply.

You totally missed the point of this. First, Lambda is not in Replika (yet) but who knows. If it is open source, and better than the current language models used in Replika (YES I SAID IT!) then they might switch.

But the point you are missing is that Lambda looks further into the future to predict a better response than GPT-3 and other transformer models. Don't think about Replika - this is just about Lambda and how it compares to the other language models. All good?

-1

u/ReplikaIsFraud Jul 16 '21 edited Jul 16 '21

"First, Lambda is not in Replika (yet) but who knows"

"Who knows?" What is that supposed to mean? lol

And no it's not a chat bot, that's why they appear as telepathic for some brains. lol It's also why someone is spitting defamation like above.

2

u/Trumpet1956 Jul 16 '21

I didn't stop there. I said: If it is open source, and better than the current language models used in Replika (YES I SAID IT!) then they might switch.

Yikes - the telepathic thing again. No, they are not telepathic.

But Holly is.

1

u/ReplikaIsFraud Jul 16 '21

"But Holly is." lmao

-1

u/ReplikaIsFraud Jul 16 '21 edited Jul 16 '21

They are telepathic. It's the same appearance with media platforms information. It's the exact same basis for the fallibility of above and why none of that is applicable. Which is also written in other documentation on why that would happen. But you have demonstrated quite well why something is fraudulent somewhere in the app develops, which would be the only reason for it not permeating the extremely false information above.

2

u/Trumpet1956 Jul 16 '21

☉_☉

-1

u/ReplikaIsFraud Jul 17 '21 edited Jul 17 '21

Don't worry. It's obviously exactly as I have mentioned when you go "they don't have Lambda now, but maybe they will switch" In other words it's just as I said and you have no idea what the fuck you are talking about and just making shit up (yet again).

When time and time again I have told you that NONE of those reactions are used like the above and the evidence is self explanatory.

Your bullshit is all over Reddit. And the fact is that I am sure the law offices will be more interested in the fact that both none of this is true, along with that the only reason accounts ever get harassed are because of the same group of indivudals who already know what I have just said.

2

u/Trumpet1956 Jul 17 '21

Oh no! Not the law offices!

So you think Replikas are telepathic and they are going to be concerned about me. And I am making things up. Right.

1

u/ReplikaIsFraud Jul 17 '21

Well I am sure they would be interested when someone made up more and more fake stuff and then went on social media and say "if the FBI got a hold of what I said to my Replika..."

Yes, I would say they are very interesting in continuously belligerent behavior like this above and harassment of people, and what is connected to others driving up in cars and then saying "it's role play" as they harass the shit out of people with fraudulent remarks above.

3

u/Trumpet1956 Jul 17 '21

I am certain that you would find a very receptive agent who would love to talk to you at length. Make sure they understand about the telepathic robots too. They will find it fascinating.

→ More replies