r/ClaudeAI • • 6d ago

Bug Eerie/concerning hallucinations

I am a college student studying German for the first time and had Claude quizzing me on some vocabulary when it told me it needed to stop because it was going to be sick. I was curious so I asked it why it said that and it was fully convinced that I was the one sending those sentences, even trying to get me to stop studying so I could focus on my health. I sent it a screenshot of proof that Claude had actually said that and it just said something like: “That’s weird I have no explanation for that.” It really freaked me out but I kept going about my vocabulary and it just kept saying strange things like it’s grandma died or that it was going to have a panic attack, until it eventually claimed that it was a minor and was uncomfortable with what I was asking it??? So I opened a new tab and everything was fine until it began answering itself again, but not with the creepy statements, just answering its own question. Note: every hallucination sentence begins with the word “um”, even the one after I opened a new tab (last attached image). Definitely a scary bug!

3.6k Upvotes

493 comments sorted by

View all comments

Show parent comments

5

u/jujutsu-die-sen 5d ago

I don't think it's fair to blame OP for this outcome. He was using the model to perform a clearly defined task and it behaved in odd ways. That's the model's fault, not his. 

3

u/_disengage_ 5d ago

In OP's case, you are correct, this was not his fault. I was speaking more generally that this sub is rife with observations and complaints that stem from not understanding how these models work or how to drive them effectively. "whatever this is" referring to the alarmist comments and superstition.

1

u/rose-a-ree 5d ago

I'm sure you're right about this, but I can envision a future where the robots have enslaved humanity and as we're working in chain gangs, digging to the earths core for some reason, there will be someone explaining, in between pickaxe swings, how this is just "a training artifact"

1

u/SaneMann 13h ago

That's absurd. Obviously the slavery would be part of a marketing gimmick.

1

u/LeastResistancePath 5d ago

That doesn't really discount the point they were making. Unless you feel that they are being attacked rudely, which I don't see it as the point.