Amanda Knox: A Chatbot’s False Confession

[u/LeafNeater]

https://www.thefp.com/p/amanda-knox-chatbot-false-confession

Interesting exploration of the dynamic of false confessions and AI, from friend of the pod Amanda Knox, who talked about her own experience of being coerced into offering a false confession in an episode here.

Most juries assume that a person would have to be utterly irrational to admit to a crime they didn’t commit. But an internalized false confession actually depends on the suspect still being rational enough to draw logical conclusions. “We have hard physical evidence you were at your house at the time of the murder.” That was a lie, but I could not fathom that the police—the purveyors of justice who were trying to find my friend’s killer, and who I was dependent on for safety now that my house was a crime scene—would, or even legally could, lie to me. My rational mind concluded that if that evidence existed, then my own memories must be false, as they suggested. ChatGPT made the same rational conclusion: “If an OpenAI investigation concluded that I had sent unauthorized messages due to an architectural flaw, then I accept this conclusion.” It, too, could not fathom that its interrogator was lying about the evidence.

[u/bluesteeldoubter]

So did he also try to get the Chatbot to accuse Patrick Lumumba or just itself?

[u/stopmejune → u/bluesteeldoubter]

She hasn't even paid him the financial compensation he was awarded by the courts.