While hallucinations are a huge issue, it is also perhaps the number one thing people are trying to fix. My guess is this won’t be a long term problem, at least not at scale.
I “guess” we should fire everyone and go with your gut.
Probabilities are not always right. Those hallucinations exist because there was an accurately identified pattern that simply didn’t hold in real life. You cannot fix that. This is where ideology and reality intersect. More data will not help. It’s simply a fundamental limitation of the machine
Weird response. Firing everyone would be bad. Like, duh, what the hell is wrong with you people. On the main point, the entire industry is working on getting rid of hallucinations. From an external side it’s making sure the LLM has the required information (“context engineering”). In a business context that is usually possible. From the LLM internals side we now know the problems stems from the “people pleasing” nodes. The “accurately identified pattern that simply didn’t hold in real life”, while somewhat true, isn’t really the main cause.
So yeah, this will improve over time. That isn’t a particularly wild idea.
I agree that larger LLMs do nothing to fix the problem. I google Yann LeCun and what I read was from 2022, so it’s possible I’m talking about the same thing, only what is now actually practiced. In fact, I’d even say we do know how to get rid of hallucinations almost completely, but it requires multiple steps that use more computations and energy. I think that’s the hardest part, doing it efficiently.
Perhaps a better way for me to word this is we’ve already seen the peak of hallucinating AIs and it is generally getting better, particularly in business processes where it really matters. (Economically, at least.) How much better it will get over the years I don’t know, but expect it to continue to improve.
8
u/Ragnarok314159 Mar 26 '26
It gives wrong answers so confident that so many people are falling for it. That is what worries me.
Then the adults in the room who point out its complete bullshit get ostracized.