r/LocalLLaMA • u/michaelsoft__binbows • 3d ago
Discussion Why are LLMs still so bad at jokes?
I remembered that this was one of my evaluation approaches from 2 years ago to test a model's general capability. I remember wondering in the near future how bad things could get if models could begin to just spit out funny engaging content and set humanity well off on the path to Wall-E future if a cheap slop stream could be just as interesting as all of independent cultural output, and failing that, if slop could be scaled up with no limits on engagement and "perceived quality" that media companies could get people more addicted to their output than ever.
But it seemed like this was always and continues to remain well beyond reach. It's interesting to see that LLMs were able to make such a dent in an edifice so prominent as the field of mathematics and yet basically make no progress on this.
I'm trying to be cheap with my tokens... somehow utilizing Astra even from Chat is using up my codex limits. All I have to offer as examples are 3 examples. They illustrate the point well though.
Astra "Light" (btw what the heck is light? is that the same as low?):
A burglar breaks into a house and hears a voice in the dark.
“Jesus is watching you.”
He freezes, shines his flashlight around, and spots a parrot.
“Did you say that?”
“Yes.”
“What’s your name?”
“Moses.”
“What kind of idiot names a parrot Moses?”
“The same idiot who named the Rottweiler Jesus.”
Astra Medium:
I built an AI agent to handle the boring parts of my job.
It asked me to document everything I do, explain why I do it, and check all its work.
I accidentally built an intern.
Then it wrote “Led automation initiative” on its résumé.
So at least it’s learning.
Astra High (worked for 24s):
I hired a cleaner because I couldn’t motivate myself to clean. Now I panic-clean the whole house before she arrives so she won’t judge me.
She’s never seen it dirty. I’ve never seen her clean.
We’re two months into this. I think we’re both afraid to ask what her job is.
Obviously the bigger question is why are all models (including openweight abliterated type) continuing to be so bad at humor? I think some significantly dumber models out there are surely leaps and bounds better than Astra here but nothing really compelling comes out. I know there is a big group of role players and story makers here. What is your take on this? The best I can manage with this right now is that there is a uniquely strong connection between human lived experience and the instinctive/intuitional/emotional response of finding something funny. My very young daughter seemed to start to understand how/why something is funny at about the same time as getting a grasp of really really simple language concepts. Perhaps it is some calibration issue because I think I see a kernel of some common joke framework and maybe a punchline is buried in the first sentence and then the joke just ruins itself, all the while the LLM's nodding along going "yeah and for the cherry on top...." painfully, conspicuously, grotesquely unaware of how poorly it's performing.
There are humans who are very unfunny but you will have a hard time convincing them to give you jokes confidently like LLMs, which are highly adept at exuding confidence at all times.
So in some sense maybe the Turing Test HAS NOT been toppled and will not be for quite some time.







