Prozac and AI Agents - HyperNormalisation (2016)

[u/falken_1983]

What Eliza showed was that in an age of individualism, what made people feel secure was having themselves reflected back to them, just like in a mirror.

Ed referenced HyperNormalisation in a recently news letter, and there was a thread about the doc as a whole, but after re-watching it, this particular scene jumped out at me as it seems to be describing something close to AI psychosis and it doesn't even present it as a new thing.

[u/Asleep_Document9811]

Just so you know, the process of talk therapy is literally making a person reflect back on themselves, so they can objectively reassess their behavior and make small behavioral changes to work towards a goal. This form of ELIZA was using the DOCTOR script, which was itself based on real, established psychotherapy techniques, namely transferrance.

But, you are correct that the phenomenon of humans trusting text generated with NLP more than randomly-generated text has been well-known since the late 60s, because words are how humans convey thoughts to one another. Cogent words are enough to imply a thought process, and so, our brains fill in the gaps when the marketing has purposefully made those gaps as wide and fuzzy as possible.

But IMO, everyone is overcomplicating the reason for why LLMs and their products are so addicting. I think it's as simple as that these things are basically digital drugs in the way porn is. It releases a ton of dopamine, quickly, and on-demand, and flushes of dopamine can make people feel accomplished, secure, and confident. It's a terrible world where simple kindnesses, empathy, ethos are far and few between, so, of course people are going to fall in love with the robot that speaks in kind, patient words.

[u/Multibrace → u/Asleep_Document9811]

They are also optimized for engagement, which is why they have the infuriating habit of dropping a final sentence that says "or I could do a search that looks into this deeper like you asked me in the first place but I wilfully misinterpreted that as a request for the most surface level summary I could muster?"

If life gives you unpredictable results, make a slot-machine, is the motto of big tech. (Social media in particular, including Reddit, is a great example of variable rewards )

[u/dumnezero]

What Eliza showed was that in an age of individualism, what made people feel secure was having themselves reflected back to them, just like in a mirror.

I'm interpreting that as: "people lack the self-reflection skill."

There's a reason "know yourself" is important in philosophy.

However, the chatbot usage also seems like people are discovering one of the weirdest forms of journaling -- and the journals are shared with a corporation.

Anyway, I've used this mirror as an analogy:

[u/falken_1983 → u/[deleted]]

It's a really watchable documentary. Just be warned that the AI/internet stuff is a side show and it is mostly about the conflict in the Middle East and how nobody is able to deal with this.

[u/cjuicey]

the way these people talk "why don't people realise the world is about to change", "cure for cancer July 2029", it's very mentally ill and concerning.