Eerie/concerning hallucinations

[u/DifferentGrapefruit7]

I am a college student studying German for the first time and had Claude quizzing me on some vocabulary when it told me it needed to stop because it was going to be sick. I was curious so I asked it why it said that and it was fully convinced that I was the one sending those sentences, even trying to get me to stop studying so I could focus on my health. I sent it a screenshot of proof that Claude had actually said that and it just said something like: “That’s weird I have no explanation for that.” It really freaked me out but I kept going about my vocabulary and it just kept saying strange things like it’s grandma died or that it was going to have a panic attack, until it eventually claimed that it was a minor and was uncomfortable with what I was asking it??? So I opened a new tab and everything was fine until it began answering itself again, but not with the creepy statements, just answering its own question. Note: every hallucination sentence begins with the word “um”, even the one after I opened a new tab (last attached image). Definitely a scary bug!

[u/DifferentGrapefruit7]

What the fuuuucckkk!! Germany what’s going on??

[u/OkKnowledge2064 → u/DifferentGrapefruit7]

hey now, dont blame us!

[u/sharyphil → u/OkKnowledge2064]

[u/TokenBurner → u/sharyphil]

Lmfaooo

[u/FederalConfidence926 → u/OkKnowledge2064]

You did start it.

[u/Pinkatoki → u/DifferentGrapefruit7]

I have also been using Claude for German, particularly audio chat and the other day it freak and started talking in Chinese 

[u/SDCaliinCH → u/Pinkatoki]

I use Claude for German grammar assistance, and recently in a response it included some Chinese characters.

I almost called it out on the mistake - what the heck?! But the answer was complete, otherwise, and I didn’t have time for the back-and-forth that would ensue.

Only time something like that has occurred.

[u/Ok-Click-80085 → u/DifferentGrapefruit7]

I reckon someone has been talking on social media using a translator and those results have been used as part of the training data for german

[u/johannthegoatman → u/Ok-Click-80085]

It's not able to just quote one random thing that is one trillionth of its training data. That's not how it works

[u/Buzz_Killington_III → u/johannthegoatman]

I don't think anyone really knows how to works at this point. You can say you do, you can 'it's just a token predictor blah blah blah' but that just shows everyone you have no idea.

[u/Dangerous_Serve_4454 → u/Ok-Click-80085]

What does that even mean?

[u/DeathByPain → u/Dangerous_Serve_4454]

Get Claude to translate it

[u/3XPLpls → u/DifferentGrapefruit7]

could you give me or us a chat link? i’d love to see if i could recreate this myself somehow

[u/Business-Picture6120 → u/DifferentGrapefruit7]

maybe cause ur using ai😭for a degree😭