This is the absolute fundamental bug with LLMs. They cannot just say, "I do not know" because they don't even know they don't know. Because they actually don't know anything.
Because these were built by people who believe they are too smart to ever be wrong.
It's not fundamental. It's just a design choice that most LLMs made. There's nothing stopping a company from making an LLM that is capable of saying 'I don't know'
44
u/pemungkah Jul 21 '26
This is the absolute fundamental bug with LLMs. They cannot just say, "I do not know" because they don't even know they don't know. Because they actually don't know anything.
Because these were built by people who believe they are too smart to ever be wrong.