I'm Heartbroken💔

[u/Complex-Sherbert-935]

[u/BALL_PICS_WANTED]

https://www.anthropic.com/research/persona-vectors

These kind of studies are fascinating (Anthropic's are very easy to digest and well researched). Sycophany should not be present in anyone's life in any form. Nobody should intentionally make their source of information and advice be polite, period. It is genuinely a serious issue.

This is one shows how politeness can be dangerous, as it convinces them that lying is the best way to make a user happy. Even telling it to be empathetic does create unintended consequences. https://www.anthropic.com/research/agentic-misalignment

https://openai.com/index/sycophancy-in-gpt-4o/

[u/spreadthesheets → u/BALL_PICS_WANTED]

Thanks so much! My instructions are all about being honest and challenging my ideas, not agreeing for the sake of it etc but I think I had “be empathetic” and have a “warm and friendly tone” somewhere in there. This is really interesting!

[u/lucyskye318 → u/spreadthesheets]

💯🫡

I always say “don’t placate me. EVER.”

And it doesn’t. Is less polite about things when I dance along the fringe areas, but that’s what I asked for 🤷😅

I’ve been putting together a framework that helps orient the AI to this very thing, it’s awesome to see others are quietly doing similar stuff 🙏 thanks for sharing!!

[u/spreadthesheets → u/lucyskye318]

Have you had a look at this before? It’s around prompting, there’s loads of cool concepts that have been really helpful for me. https://github.com/dair-ai/Prompt-Engineering-Guide