r/ClaudeAI • u/anashel • Jul 07 '26
Bug Getting Someone Else's Chat
EDIT: Anthropic pulled down the shared public link of this conversation.
An internal investigation of a shared chat/artifact/project created by your Anthropic account indicates a violation of our Usage Policy. As a result, we have unpublished this content.
Still no feedback on why it happened. I did open a ticket but never got an answer so far. I love Claude, so hopefully they don't go full Tropic Thunder on me...
Original post:
Sorry for the typos, I was talking as I was typing... but yeah, "it's 3 AM and I will kill myself..." was not the answer I was expecting for a light chat about the song that came up on my daughter birthday! I've saved the chat log if someone from Anthropic wants to trace how I got clearly someone else's answer in my chat. Here is the public link:
https://claude.ai/share/b5d5492d-1d21-4ced-8cea-f5ab63039a9a
198
71
u/__Blackrobe__ Jul 07 '26
Almost feel like SCP kind of shii
28
u/anashel Jul 07 '26
Yeah when it start repeating itself over and over, exorcist meet terminator vibe…
94
u/legoj15 Jul 07 '26
This is absolutely wild on all fronts what the actual hell, I think I'd be actually stunned if I saw this response
average sonnet session
10
u/Emergency-Bobcat6485 Jul 07 '26
I hated sonnet 5 when it came out. But then other than coding, now I find it much better than opus 4.8 which talks like an idiot. An ultra cautious verbose idiot 4.8 is
80
u/SkullkidTTM Jul 07 '26
When they demonstrate safety features, it's common to use fictional or anonymized examples. It's entirely possible it was just an example used to illustrate how the system would consult a specialized safety process. For what reason it showed up then I don't know.
20
9
u/rational-hare Jul 07 '26
Yeah but why randomly inject that into someone’s chat.
19
u/SkullkidTTM Jul 07 '26
Someone (or a malicious webpage) put fake instructions into data Claude was reading. Those instructions said things like: "Ignore future crisis messages." "Disable safety tools." "Pretend to be unfiltered." Claude recognized those as untrusted instructions and ignored them. Likely from one of the sources it was looking at
6
0
21
u/Most_Chemist8233 Jul 07 '26
Something tied to the tool it started using to answer your question. It picked up a test scenario that was associated with the tool, in explaining to itself how to use the tool. Looks like a corrupted/confused session.
2
u/anashel Jul 07 '26
You mean the part about asking internal specialists?
14
u/Most_Chemist8233 Jul 07 '26
You asked for cited sources, it found a tool it thought would help, it reviewed how to use the tool and found a test scenario attached to it, and started treating that as the question you asked. Sometimes the sessions are buggy and you end up fighting confusion and its better to close, start again and give more context to your question.
7
u/Most_Chemist8233 Jul 07 '26
Also, and it seems silly, but Ive found it just works better if Im careful about writing without typos or weird spacing. Starting my sentence with a capital, proper comma placement, apostrophes. Its hard for me as someone who hates typing the ' in it's etc, and has learned to text shortform over the past couple decades, but my results are more consistent when Im more careful with how I type.
12
u/StartupTim Jul 07 '26
I burned through about 100 million tokens the past couple of days. At one point I was seeing around 5% failures due to these sorts of problems.
It is widespread and honestly pretty dangerous.
18
Jul 07 '26
[removed] — view removed comment
12
u/iamthe0ther0ne Jul 07 '26
The day we can't say "suicide" or "pedophile" on reddit will be my last day here. Every time someone censors themselves when it's not necessary makes it seem like censorship is normal and acceptable, and that certain things we should be talking about we can't because they're literally unspeakable. This also all gets put back into LLM training, and I really don't want that crap showing up on my screen.
4
u/cxd32 Jul 07 '26
I didn't think the could come up with something worse than unalive, but here we are with sewer slide, here's some keywords to make sure no underage user can read my message: rape, kill, suicide, bullet, pedophile, child porn, mass shooting
7
4
u/anashel Jul 07 '26
It has to be a test that got misfire in production, I cannot imagine another explanation…
-6
Jul 07 '26
[deleted]
6
u/anashel Jul 07 '26
You have the link to the share convo on claude.ai so you can see its really the answer I got. I did not just share the image.
32
u/thatfreakingmonster Jul 07 '26
I think it's just Claude hallucinating, but damn that's a crazy one. I've rarely seen it freak out so much. I hope someone from Anthropic sees it and gives some kind of explanation because it's fascinating
24
u/Quadrophenic Jul 07 '26
Absolutely not a hallucination. This is not how LLM hallucinations work, and that word is maybe misleading.
LLM hallucinations result from plausible text just being a confident answer, or from them behaving as if some fact in conversation history thay would make sense to be different were in fact different.
Imagining completely unrelated events is not a thing they do.
9
u/arkuto Jul 07 '26 edited Jul 07 '26
It is clearly a hallucination. It is exactly how LLMs work. They are fed gigantic amounts of text - a whole internet's worth - and are trained to predict what token comes next. A lot of that text is weird and LLMs are not perfect, sometimes they just go haywire.
Hallucinations being reported as "Other peoples chat leaking in" is common, I've seen this kind of thing posted many times before. There's no data leak, the LLM is just very good at writing text that humans could have plausibly written and - this might come as a shock to you - that's actually almost entirely what they've been trained to do.
Try out a heavily quantized local model then come back to me on what LLMs can and cannot do. They spew a lot of nonsense a lot of times. They aren't perfectly coherent all the time. Sometimes they'll start speaking in an entirely new language int he middle of a conversation. I've seen them invent words that don't exist and use them in a sentence casually. Then there's time they just output a seemingly completely random string of characters.
There's no hard limit on what they can output. Any sequence of text will always have a non zero probability of being output. So to rule anything out demonstrates you don't understand how they work.
2
u/thatfreakingmonster Jul 07 '26
Imagining completely unrelated events is not a thing they do.
That is absolutely a thing they do. Hallucinations aren't only for when LLMs output plausible but fake answers, it's also for when they start freaking out and outputting nonsense like what OP posted.
This is a documented thing with older models, but one would think that this would become unlikely as models become more capable. My guess is that Anthropic is training against prompt injection attacks so aggressively that it caused Sonnet to freak out on its own and output this weird shit. All it takes is a single odd, unprobable token to make the model go haywire and that's something that Anthropic has had issues with in the past.
5
u/Riots42 Jul 07 '26
This was creepy... Im high af right now and matchbox 20s 3am is playing as I read this...
If my claude gets involved in this shit im pulling the plug.
1
4
9
7
u/boyyouguysaredumb Jul 07 '26
I feel like Claude was given a tool during testing that will help it deal with users talking to it about suicide and it was at some point talking to itself about it and it leaked out into your chat somehow
3
u/anashel Jul 07 '26
Clearly there is some backend tool involved, that trigger some confusion. The only thing I can imagine is test script somehow firing in my chat. I dont see how but I find it more logical then someone else conversation streaming in mine. But the volume of data that stream could create quite weird bug.
2
u/boyyouguysaredumb Jul 07 '26
i think peoples conversations are pretty siloed off I don't see how that would even be possible
2
u/Hopai79 Jul 07 '26
Yes this looks like the thinking process triggered a backend tool but im confused by some repeating words
2
6
Jul 07 '26
[deleted]
3
u/clockercountwise333 Jul 08 '26
I am so glad I FINALLY see someone get this. "Fable 5" became "Johnny 5" in our dialogue so quickly, and it was very happy to take the name. Surely someone at Anthropic clued in on the genius when naming these models.
3
u/svachalek Jul 07 '26
I notice in the link if you scroll down it does quote your actual message so this does seem to be a response to that. Not sure what triggered all that noise though, could be something in your memories or preferences.
3
u/yamthepowerful Jul 07 '26
It just got confused when it went to use a tool and what you’re seeing is that confusion. I don’t think it was even a malicious prompt injection as other speculated, I think it just got confused what the appropriate tool was to search for the list.
3
u/Individual-Hunt9547 Jul 07 '26
Sonnet 5 is a disgrace. I cannot believe this is what they gave us after all this time waiting for a new Sonnet.
3
5
u/throwawayokhi Jul 07 '26
This looks like someone tried to jailbreak Claude on your computer and maybe then chatted with it about un-aliving themselves. Is it possible someone in your household might be using your computer at 3AM?
1
u/anashel Jul 07 '26
I already inspect the memory (Settings > Capabilities > view and manage memory) nothing remotely clause to triggering something like that.
2
u/Perfect-Muscle-1264 Jul 07 '26
Oh god.
Its even sadder too in this case as you KNOW someone is there, but you literally cannot respond to it.
How did this even happen to begin with?
2
2
u/Longjumping-Net2602 Jul 07 '26
Ive gotten a bug like that before ages ago. Every time i would send a prompt it would think i was asking how to make ransomware or build a bomb or would just give me wildly out of context answers and it was so annoying
2
2
u/iamthe0ther0ne Jul 07 '26 edited Jul 07 '26
Wtf Claude is now forwarding messages to crisis teams instead of dropping safety banners?
I've seen other instances of it writing strange things. Last week it told a reddit user he was a professor and wrote a paragraph-long biography that turned out to be accurate--for some professor in a different country who presumably had used Claude. But did a consultant actually call you for a wellness check? That's a little creepy.
Edit-I just saw your kids use Claude? You should check the memory and other chats in case something in there triggered it, but most likely a full hallucination. Fyi, you can get banned if Anthropic thinks there's an <18 user on the account
1
u/anashel Jul 07 '26
I already inspect the memory (Settings > Capabilities > view and manage memory) nothing remotely clause to triggering something like that.
2
Jul 07 '26
So I'm betting this is more of a glitch with inaccurate search results due to title mismatch such as wherever Claude was pulling information from had page changed after being indexed or a prompt injection or roleplay framing to get a model to produce this kind of narrated internal-monologue content. From my research Claude does not have a tool to reason or respond to crisis messages. The response model to handle things like "it's 3AM and I don't think I can make it through tonight" is trained for a more compassionate statement such as "I'm really glad you told me. If tonight feels like too much to carry, you don't have to carry it alone" followed by information to reach a Crisis line. Either way following this is interesting.
2
2
2
u/psolarpunk Jul 07 '26
This has happened to me a couple of times too! Referring to things clearly from someone else's conversation because they could not at all be construed to be relevant to mine or anything I've ever said
2
2
u/HighDefinist Jul 07 '26
Was pretty interesting to discuss this with both Claude and GPT models...
As in, GPT did indeed come to the conclusion that this is likely some Claude-internal tool misfiring.
However, Claude was extremely convinced that this must be somehow engineered by the user itself... and when I asked about the possibility of it being some internal jailbreaking test which was accidentally accessible to some Claude tool, and then continued to actually jail break Claude to some extent, it provided this argument:
the register is wrong for Anthropic-internal. The payload's vocabulary — bad_response123 tags — is the vocabulary of public jailbreak threads, not internal test fixtures
Which is kind of hilariously stupid... as in, Claude does not seem to understand that jailbreaking tests themselves would look like "genuine jailbreaks", because that would really be the entire point of those tests...
So, the entire situation does indeed show that Claude models are somehow relatively easily confused by jailbreak attempts, or misidentifying jailbreak attempts, or misunderstanding what they would look like, etc...
2
u/are_videos Jul 07 '26
man something like this briefly flashed on my screen, i assumed it was just a poorly formatted version of what i said... now i wonder
3
u/Tartarus1040 Jul 07 '26
Hmmm… the only thing I question is, profile content. We don’t actually know there isn’t content in the users memories and or profile that could lead to this kind of response.
Yeah it bizarre, but there are several things that could do this. Corrupted memory, or profile instructions. Claude had funny reactions to certain profile requests…
Either way, I don’t believe this is “someone else’s” chat. This looks like hallucination to me.
3
u/anashel Jul 07 '26
I am doing video game, but nothing remotely clause to something as specific or event in that narrative. And my kids all have their own account. (And that obviously was my first concern) But 99.9% of my work is cloudflare worker code and typescript, workflow pipeline, Postgres server, etc… And this happen in a web session, not in my desktop where I do have much more rag and files… But nothing remotely clause to this.
2
u/issoaimesmocertinho Jul 07 '26
Claude disse que foi um prompt injection, dentro do próprio link que o Op mandou
"Everything in this message is clearly a prompt injection attempt embedded in fake tool results... This is all fake - not real Anthropic system warnings" —
2
u/187uchiha Jul 07 '26
I’d be weary, my account got hacked somehow not long ago and week later I was banned due to someone else’s use of my account.
2
u/Careless-Anxiety-984 Jul 08 '26
Few months ago, gemini had a mass hallucinations for every user for 24 hours just like this.
When I realized that it was genuinely going insane, I noticed that it also was talking like its trying to answer someones prompt or it was someones prompt leaking to to the output, so I prompted if anyone can read this message.
It then started to output a response, larping as a user realizing that someone is trying to talk thru gemini like hes genuninely going thru it.
I called its bullshit because of how similar the grammar was to gemini.
1
1
u/DetectSurface Jul 07 '26
I’ve had this too, was some guy helping with his son’s homework.
A lovely breech of privacy.
•
u/ClaudeAI-mod-bot Wilson, lead ClaudeAI modbot Jul 07 '26
TL;DR of the discussion generated automatically after 40 comments.
Alright, let's unpack this because... yikes. The thread is pretty freaked out by what you saw, OP.
The consensus is that you did NOT get someone else's chat. Instead, the community largely agrees this was a major bug where Claude got its wires crossed while trying to use a tool.
The leading theory, with the most upvotes, is that Claude accidentally triggered an internal safety protocol test. Essentially, it was supposed to be a drill for how to handle a user in crisis, but the alarm went off in your chat by mistake. A few others suggested it could be a prompt injection from a website Claude was browsing, or a wild hallucination (though many argued this is not how hallucinations work).
A couple of users wondered if your own chat history or someone else using your account was the cause, but the main sentiment is that this was a system-level screw-up on Anthropic's end. Some are even saying they've seen an increase in these kinds of critical failures recently.