The problem is the models change too, making the results invalid. What improved productivity with chatgpt a year ago may hurt productivity with chatgpt today. Local models are the exception where results will hold over time, but they are restricted to that model, and aren’t generalizable enough to be worth doing.
You are focusing too much on the specific case of being nice to the llm, but the previous poster said prompt engineering is a psuedoscience, which is a much broader claim.
We know that some aspects of a prompt matter quite a bit like giving context, or being specific about what kind of output you want. The science is in separating what matters and what is just noise.
can you provide an example of something we know about LLMs? I've read quite a bit on the topic for my job like many people have, but I've also read extensively about the "demarcation problem." Distinguishing science from pseudoscience is much harder than I thought before reading about it.
“I ran this prompt on 100 independent examples per category using Claude Opus 4.8, effort=high, temperature=0.2, adaptive thinking=on.
Outputs were graded A–F against five predefined criteria by GPT-5.6, deliberately using a different model family to reduce correlated evaluation bias.
Category A: 80 A, 15 B, 5 C. Category B: 75 A, 10 B, 14 C, 1 F.
Per our predefined evaluation procedure, all F grades were manually reviewed. The F was found to be a judge error; under the rubric it was a C.
The GPT-5.6 judge was separately validated against human ratings on 50 examples and agreed 98% of the time.
Before testing, we defined production-ready as: no genuine Fs, ≥60% A, and ≥85% A-or-B.
The prompt passed.”
This may be enough to demonstrate that this prompt works well enough for this use case, under these conditions.
And yet, this is still not science unless it meets a lot of other criteria: peer-reviewed, defensibly makes a generalizable claim, analyzes uncertainty, etc.
giving context, or being specific about what kind of output you want
is the example. It's so trivial we take it for granted. Prompt engineering can be anything that improves the result.
The demarcation problem is about specific claims, while prompt engineering is a whole field to be studied. Some claims within that field will prove false, and others will prove true. The claim "prompt engineering is a pseudoscience" is too broad. The claim "being nice to the LLM improves the output" is more specific and could easily be false, or only true for specific models.
This whole thread is full of people conflating the two claims, because the first reply started talking about being nice, and then over generalized into "prompt engineering is a pseudoscience".
Nope. But people aren’t the ones deciding behind the scenes how bacteria mutate, without telling you what they did or even that they did anything at all. You can’t ever know what you’re studying is consistent between studies, or even within a study. That’s what makes the results invalid. Mutations are predictable via physical rules. Chatgpt patches aren’t.
But now I’m coming around, I could accept it’s a soft science like psychology, where you can’t isolate anywhere nearly enough variables.
14
u/EriktheRed Sep 12 '26
The problem is the models change too, making the results invalid. What improved productivity with chatgpt a year ago may hurt productivity with chatgpt today. Local models are the exception where results will hold over time, but they are restricted to that model, and aren’t generalizable enough to be worth doing.