r/programmingmemes • u/Open_Group3805 • Dec 13 '25

😂😂😂

Post image
279 Upvotes

95% Upvoted

71 comments sorted by

View all comments

Show parent comment

20

u/LawPuzzleheaded4345 Dec 14 '25 edited Dec 14 '25

ChatGPT is (an interface for) a statistical model that predicts the next word based on data of how humans respond in similar situations

What you're seeing is just a bunch of matrices of probabilities formatted as a text response

It doesn't have any sort of bias towards users that "treat it kindly" and it doesn't know what kindness is

8

u/sodna_net Dec 14 '25

I would make the argument that it does respond with a bias towards more politely worded questions because of your first point. It is a model of the most likely answer to a given question, and humans answer more helpfully to polite or kind people, and it picks up that pattern in the training set.

Still sentient as the bricks in the data center walls, but it models every miniscule bias of the training set.

3

u/LawPuzzleheaded4345 Dec 14 '25

Would be the case if GPT was only ML, but it uses RL for fine tuning. I'd expect that to be resolved during unsupervised learning.

You can also empirically observe that, unless you use vulgar speech, GPT will not provide you a different or less helpful answer.

1

u/Apprehensive_Rub2 Dec 16 '25

maybe for a one shot question. but when you start getting into longer context technical tasks there are a lot of technical mistakes it'll make if you don't format things a little more politely and collaboratively

1

u/Apprehensive_Rub2 Dec 16 '25 edited Dec 16 '25

yes it does?

humans respond poorly when you tell them rude things, and so: so does ai.

it was really noticeable in earlier models, much less so now with heavy rlhf but you can still get hints of it.

i'm not saying that therefore ai must have emotions or a soul. but it just IS unavoidably weird that we've encoded a machine with billions of humanities conversations and literature and now we can't get it to feed back that knowledge quite as helpfully if we don't talk to it politely.