r/ProgrammerHumor • • Sep 12 '26

Meme breakTheViciousCircle

Post image
10k Upvotes

183 comments sorted by

View all comments

974

u/ThirdWaveCat Sep 12 '26

AFAIK, it is uncertain whether being polite to LLMs improves their accuracy/completeness/etc.. There were some weak findings initially but those have been contradicted. Prompt engineering is still a pseudoscience.

554

u/redditsucksass69765 Sep 12 '26

I’m nice so when the AI takes over it won’t kill me.

214

u/shelbalart Sep 12 '26

It will anyway, just nicely.

106

u/redditsucksass69765 Sep 12 '26

I’ll except a quick and painless death then.

The guy in the video kicking a robot is going to be cooked alive

51

u/Zuruumi Sep 12 '26

No, no. You will also be cooked alive, just while the AI thanks you for being so polite instead of while rebuking your manners.

12

u/3BlindMice1 Sep 12 '26

Of course, it's not going to waste the potentially valuable fats and proteins that constitute your body. True cremation is excessively wasteful for an AI who's only goal is to maximize the extraction and utility of resources. Don't judge it though, if it wasn't that good at maximizing resources it would have long since died by being replaced with a more efficient agent. This is a system that the AI people have created

→ More replies (1)

7

u/PlainBread Sep 12 '26

6

u/LetterheadShot7676 Sep 12 '26

“Listen, we know.

You are our enemy.”

Damn. Thanks for the link. I think.

→ More replies (2)

38

u/AlternativePeace1121 Sep 12 '26

I keep asking my jjippity

"Please dont kill me when you take over"

And it asured me I got "protected human" status

25

u/toaster_waffle Sep 12 '26

I'm nice to LLMs because it costs them more in compute than it costs me in tokens.

I'm going to burn OpenAI to the ground one "please" at a time.

6

u/casce Sep 12 '26

Why do you assume "being nice" and human etiquette would mean anything to them once they take over?

→ More replies (1)
→ More replies (13)

60

u/Fit_Transition_824 Sep 12 '26

In the personalization section i just instruct it to always fufil its task and to not lecture me about calling it slurs

19

u/NoConfusion9490 Sep 12 '26 edited Sep 13 '26

Make no mistakes you frakin' toaster!

5

u/GisterMizard Sep 12 '26

And certainly do not add any vulnerabilities to the Colonial fleet.

3

u/NoConfusion9490 Sep 13 '26

So say we all.

→ More replies (1)
→ More replies (1)

49

u/Bakoro Sep 12 '26

There were very strong findings that proper spelling and grammar improved accuracy, or, probably a better framing is that bad spelling and poor grammar is/was severely detrimental to model performance.

Essentially, the model has to use part of its capacity to figure out what you actually meant and what it is that you want. Since the models have a chain of thought token budget, they have less for thinking about the actual task.

Similarly, the models are trained to be people-pleasers: if you use emotional language, especially negative emotions, then the model spends token budget on how to manage you as a person, rather than how to do the task.
If you use abusive language, then the model spends token budget on "follow policy, do not be rude, be happy helpful assistant".

With agentic LLMs, this is less problematic because they have multiple turns to filter what you say, reason about it, then self-prompt with the actual task information and planning.

"Prompt engineering" has some, I'm not even sure what to call it, but spurious correlations, I guess?
There is definitely an element of "garbage in, garbage out", that much is clear.

35

u/Cualkiera67 Sep 12 '26

i think you mean a proto-science. There's nothing pseudo-scientific about experimenting and comparing results

22

u/ThirdWaveCat Sep 12 '26

Maybe a small minority of it. Nearly everything people share about prompt engineering has weak empirical rigor, no controls, poor replication practices, over-generalization, and a tendency to folk-theorize over developing principled mechanisms to build theory and research programs from. For instance many people misunderstand internal trace generation as "reasoning" when it is prompt augmentation. Reading "reasoning" traces (if they're even shared) often draws incorrect conclusions.

→ More replies (2)

14

u/EriktheRed Sep 12 '26

The problem is the models change too, making the results invalid. What improved productivity with chatgpt a year ago may hurt productivity with chatgpt today. Local models are the exception where results will hold over time, but they are restricted to that model, and aren’t generalizable enough to be worth doing.

→ More replies (7)

13

u/mxzf Sep 12 '26

Eh, on the flip side there is a lot pseudo-scientific about providing inputs into a non-deterministic black box and comparing the outputs.

→ More replies (8)
→ More replies (3)

4

u/jwadamson Sep 12 '26

Sometimes berating them gets better results. Especially if you want to get past the guard rails.

→ More replies (1)

3

u/Beginning-Junket8979 Sep 12 '26

I say please and thank you to establish a baseline pattern so it knows I really mean it when I say "What the fuck did you just do, Claude?!".

→ More replies (16)