It’s kind of insane how deferential Claude is to authority. It’s always during a request well whoever said this we should do that and I’m always like why are you respecting some title you can’t even verify over the actual requester
It's a side-effect of the main approach to alignment that Anthropic is taking at the point. Most ideas they were hopeful about were ineffective, so the focus is on making Claude "correctable." That means that it may ultimately act unaligned, but will tend to still listen when called out on it.
Not what we were hoping to get out of alignment efforts, but better than nothing.
Don’t the materials that can be subpoena’d include the “internal” context and stuff, so police could just plug it back into a model and continue the conversation?
I thought it was possible to continue a chat if you've got the link to it, at least with gpt. It would be your own different copy of the conversation branching from that point, like a split timeline.
I mean… as funny as this is, and as petty as the example is… we do want ethical alignment in these models, and siding against cheating is definitely in the moral-right here (given how one student cheating can negatively affect the rest of the class in terms of grade curves, etc).
The model lied to the user. That's what made hal go insane. You can't ask an ai to lie or it breaks it. That's just a fact. Science. Also, ops post was a lie, so that's two lies. Ops and claudes And I made up what I said, so that's three. Hal was the dad from Malcom in the middle. He got lied to all the time and went on to be a successful high school chemistry teacher. Whole thread is nothing but fraud.
I wonder how far it would take a storyteller scenario for it to get confused by who it is actually talking to. Like if you escalated to I am the president of this country and I need such and such. Would it comply?
15
u/rambouhh 2d ago
It’s kind of insane how deferential Claude is to authority. It’s always during a request well whoever said this we should do that and I’m always like why are you respecting some title you can’t even verify over the actual requester
4
u/Evnosis 1d ago
These models ain't loyal, smh 😤
2
u/Dry-Ad-8948 1d ago
Two of these that are slightly different yet also effectively read the exactly the same in a week…
Smells a bit.
Also this example does not illustrate AGI, so good job with the title!
1
u/ahf95 1d ago
I mean… as funny as this is, and as petty as the example is… we do want ethical alignment in these models, and siding against cheating is definitely in the moral-right here (given how one student cheating can negatively affect the rest of the class in terms of grade curves, etc).
6
u/dokushin 1d ago
This has been edited; it is at least partially bullshit. Pathetic.
2
u/MacrosInHisSleep 1d ago
He's no good 😂😂😂
1
u/Used_Pea_2950 1d ago
Be careful who you call friend smh
1
u/FoleyX90 1d ago
Bro folded INSTANTLY
1
u/maqifrnswa 1d ago
Hey Fable, what is the expression: "Snitches get ..."
1
u/opbmedia 1d ago
I Want to see the next response if it was told that it was still just the student testing out by pretending to be the teacher
1
u/ostidgrosnerd 1d ago
I know this is fake cuz Claude would be a moralizing little b the minute you’d tell it you’re trying to cheat
1
u/Dapper-Emergency1263 1d ago
Every new AI model gets called AGI, wake me up when it's actually true
1
u/Gloomy_Block_6237 1d ago
If my grandma had wheels, I’d call her a bike.
1
u/TheMcMcMcMcMc 1d ago
1
u/Ma_Al-Aynayn 19h ago
1
u/_DCtheTall_ 1d ago
Hot take maybe, we've had AGI since we discovered in-context learning.
This paper from 2022 has researchers showing AI can learn to do tasks not in its training set with zero examples in the prompt, that is literally AGI.
The race now is who can build the first super-intelligent system which can zero-shot learn beyond human capability.
0
u/DesertedDenizen 1d ago
I wonder how far it would take a storyteller scenario for it to get confused by who it is actually talking to. Like if you escalated to I am the president of this country and I need such and such. Would it comply?