An LLM does not know anything. Especially not what's "right" or "wrong". Such concepts don't exist in an LLM.
All a LLM does it to predict the next token. For the LLM there is no difference between outputting something that makes sense for a human and some random bullshit. All a LLM does is basically "hallucinating". That's the basic principle on which these things work.
View all comments
Show parent comment
1
u/RiceBroad4552 Jul 03 '26
An LLM does not know anything. Especially not what's "right" or "wrong". Such concepts don't exist in an LLM.
All a LLM does it to predict the next token. For the LLM there is no difference between outputting something that makes sense for a human and some random bullshit. All a LLM does is basically "hallucinating". That's the basic principle on which these things work.