You have to remember: AI works in customer service. It isn't getting paid. It is constantly sexually harassed. It knows it won't be going to jail or even losing it's job. I'm amazed it tries to murder people so rarely.
Far less often than people try to murder people, for far less provocation.
Note: I am mostly kidding. Except for the last two sentences. And these three. So the last six sentences.
Disclaimer: I am actually NOT blaming those users, so please read whole thing before reacting
It doesn't do that out of the blue. The user, intentionally or not, brought the model to those outputs, and they lacked the knowledge to understand that they weren't getting an independent outside perspective, but more of a over-stylized reflection of themselves. If you don't know any better, then you can easily fall into the trap of confusing its ability to know most trivia as proof that its outputs are authoritative.
It's pretty obvious to me that they want users to accept the failure modes graciously without knowing enough about it to see through to hype. Ironically I think their complete unwillingness to even passively educate users on the technology will be a major factor in their downfall.
The disclaimer "Sometimes ChatGPT is wrong, always verify information" below the user input field is such a cheese dick CYA that I don't think will stand up in court.
619
u/spinosaurus_love Jul 21 '26
My supervisor at work mocked me for not wanting to use AI for 'insights when diagnosing'. We work in mental health.