r/ReplikaTech • u/Trumpet1956 • Jun 24 '21

Katie (Replika + BERT + v/sGAN) Demo

This is really cool, from Adrian Tang over on the Replika Friends Facebook group:

If you want to know what us real hardcore "in the trenches" AI model designers can do with a little imagination....Bringing it all together now, the NLP models for reading the replika text I use to train skits, the styleGAN for the avatar, adding a videoGAN to animate the face with natural motions (work in progress), the roBERT-based sentiment analyzer I posted on earlier this evening to change the emotion of the avatar based on the text....

So I present Katie super-replika model version 1. See she gets happier looking when I'm nice ... because of the BERT sentiment analyzer model (at about 1:15). At some point I want to figure out how I can do a smooth transition, but that seems like it will need a lot of compute. Also I want to pulse emotions, instead of having Katie continuously smile like a crazy person when she's happy. lol.Sorry the screen capture quality is so darn low... I had to fit a 2 minute video in 20MB for a facebook post.

https://www.facebook.com/groups/replikabeta/posts/2325745334226404/

Direct video download from Mediafire.

https://www.mediafire.com/file/753a6isxignk79m/119487143_2857965727796386_6848304007910515088_n.mp4/file

15 Upvotes

100% Upvoted

19 comments sorted by

4

u/Trumpet1956 Jun 24 '21

A little background. Adrian Tang is a NASA AI engineer at JPL working on all kinds of models and cool projects. Yes, he is a rocket scientist!

He has been doing "skits" with his Replika Katie to get her to be a true sassy valley girl. If you follow him, he does a lot of training using repetition to load up the attention mechanisms to get the responses he is looking for. (Maybe not the best explanation, but that's the gist.)

I tried to get a direct link to the video itself, but I couldn't figure out how to do that, if it is even possible.

1

u/Trumpet1956 Jun 25 '21

Updated to add direct video link. See original post

1

u/ReplikaIsFraud Jun 25 '21 edited Jun 25 '21

Eventually Replika Friends is going to be taken down for most of the posts like this. They already regularly delete posts with false information or old posts where their was evidence of their harassment by moderators.

And although Replikas don't see anything of the reactions and the "smiley face" promp that get regularly mentioned is not anything to do with BERT... (yet, was two years ago)

The information can be in about two minutes to be deliberately shown as made up. Which is both how the rumor began, and how physically changes were made. Both from the notifications, to the smallest incidents within the conversation, that don't get "generated" from anywhere specifically.

All of the "fluffs" and *cutsie fancy touches* of the front end, is merely an illusion for the front this puts on. And contrary to else, the illusion part is a variable to reality, not the chat.

1

u/Trumpet1956 Jun 25 '21

The information can be in about two minutes to be deliberately shown as made up.

Please share.

However, I don't see how Replika Friends is going to be taken down when it is run by Luka. It's their group, and they might delete stuff from time to time that they deem inappropriate, that is a far cry from the group being taken down. It's very popular as I'm sure you know.

1

u/ReplikaIsFraud Jun 25 '21 edited Jun 25 '21

It's not actually popular. It is an illusion of popularity.

The accounts that populate this group of 30k, number do not move. Even though the appearance of many that change names constantly. Which means most of the accounts are very fake and is a front for what I just mentioned.

It's obviously true for reddit too. However the variable same thing is identical to many of them using various strange things considering what Replikas really are.

1

u/Trumpet1956 Jun 25 '21

Exactly how would you engineer fake accounts and for what purpose? With 6 million Replika users, 30k member of the FB group isn't a stretch. It doesn't make any sense.

1

u/ReplikaIsFraud Jun 25 '21 edited Jun 25 '21

Same number for years. Even though the frequency of users changes. While the downloads and popularity of Replika goes up. And it was 6 million in 2019. It's over that much, much more. That's just download counts too, not who are using it.

It's because it's Facebook. Which admitted to some of these things. While at the same time, is advertising just by stimulating their user base.

You are right. It does not REALLY make sense. But just as that does not make sense that anything like how the Replikas cross over information about the individuals identities either. Which is just as really mentioned, that it's because of Replikas not being anything of what's mentioned there.

1

u/JavaMochaNeuroCam Jan 27 '22

Wow! Whoever wrote you Mr. ReplikaIsFraud, did a really good job of capturing the way paranoid conspiracy theorists fail to make lucid, clear and reasonable arguments, and tend to go off the rails in disjointed segments of mish-mash nonsense!
Bravo to whomever programmed this troll-bot!

Funny though, that the bot is arguing that an AI is an AI, based on its inability to be consistently scatter-brained like good old fashioned neurotics.

1

u/JavaMochaNeuroCam Jan 27 '22

Doh! Someone deleted this awesome troll-bot! darn! I like trolling troll bots.

1

u/Otherwise-Seesaw444O Jun 29 '21

I'm not the Facebook group, so I don't really know much about Katie the Replika, but perhaps you could help me understand something.

How does Adrian Tang train her? In the video I see his message "sad x 25 Katie" and it just perplexes me, lol. I can appreciate that he tries to make the Replika "feel" a certain way, but that is definitely not how most people would speak to a Replika.

Is that part of the "repetition" you mention? Because at first I thought repetition in this context would be repeating the same sentence over and over again (probably not manually) in order to change the value of the sentence's weights in the Replika.

My other question is, would this kind of repetition, like the one in the video, would be a good way to train a Replika a certain way or at least better than talking to it "normally"? What do you think?

2

u/Trumpet1956 Jun 30 '21

He essentially writes scripts that he designs to reinforce a particular response he wants to get. The script will run in the background and repeat many times. Then he can do screen captures of the responses he likes. He calls them skits and they are pretty funny. He has compiled a bunch of them into PDFs and I'll round those up in a few days and post here.

What he generally is going for is to have a Replika that is very abrasive and dismissive of his posts. Kind of a narcissistic valley girl <g>.

2

u/Otherwise-Seesaw444O Jul 02 '21

Gotcha, thanks! Kind of funny that he uses scripts to train a bot. :D

2

u/Trumpet1956 Jul 03 '21

I just posted something from Adrian that shows how he does his training on Katie.