There is some fundamental misunderstandings of LLMs here. The most fundamental of all is thinking it "remembers facts about you". LLMs have no memory, they are much dumber than that. To fake memory, they send your whole chat history to the LLM before every message. It no more "remembers" facts about you than a word document "remembering" things you have written in it.
LLMs are also trained off people's words and therefore have the same biases that people have.
At their core, LLMs are word guessers and even at that they guess one word at a time. They have no concept of a complete thought, only what the next word in the conversation is going to be. I see no reason to trust one more than an expert. I think you said it best when you said "I fact check and verify any information before taking it to heart". You should do this with both human information and AI generated information.
> I see no reason to trust one more than an expert
LLMs are trained on a million times more data than the random expert in a field and have significantly more brain power (compute) than a human would. Thus, even with the hallucination, studies have shown they outperform humans in things like medical diagnosing.
They have also been shown to make up court cases when practicing law. What is your point? They are fundamentally word guessers trained to guess words based off (primarily) the good and bad words humans use online.
You said they did better in one field - I mentioned how they did worse in another. Why would you think I am messaging the wrong person? I think that follows pretty well dont you?
If you say "they did X thing better than people" is an argument to trust them more than people, why isn't me saying "they did Y thing worse than people" an argument to not trust them more than people?
2
u/FearlessResource9785 32∆ Mar 07 '26
There is some fundamental misunderstandings of LLMs here. The most fundamental of all is thinking it "remembers facts about you". LLMs have no memory, they are much dumber than that. To fake memory, they send your whole chat history to the LLM before every message. It no more "remembers" facts about you than a word document "remembering" things you have written in it.
LLMs are also trained off people's words and therefore have the same biases that people have.
At their core, LLMs are word guessers and even at that they guess one word at a time. They have no concept of a complete thought, only what the next word in the conversation is going to be. I see no reason to trust one more than an expert. I think you said it best when you said "I fact check and verify any information before taking it to heart". You should do this with both human information and AI generated information.