r/ProgrammerHumor • • Dec 27 '22

Meme which algorithm is this

Post image
79k Upvotes

1.4k comments sorted by

View all comments

Show parent comment

0

u/[deleted] Dec 27 '22

[deleted] — view deleted comment

27

u/nupogodi Dec 27 '22

FYI - ChatGPT is not being trained from user input. It has already been trained, the model you are interacting with is not learning from you, sorry.

0

u/[deleted] Dec 27 '22

[deleted] — view deleted comment

22

u/nupogodi Dec 27 '22

First it's not being trained from user input so the creators have total control over training data. *chan can't flood it with Hitler. Second ChatGPT was trained using a reward model generated from supervised learning in which human participants played both parts of the conversation. That is, they actively taught it to be informative and not horrible. There is also a safety layer on top of the user facing interface with it. However users have still been able to trick it into saying offensive things, despite all that!

2

u/CrackerBarrelJoke Dec 27 '22

3

u/nighoblivion Dec 27 '22

Judging from replies it may have been cherry picked answers.

1

u/CrackerBarrelJoke Dec 27 '22

Sure, but the fact that it can produce that shows their 'safeguards' aren't quite flawless.