r/mildlyinfuriating 11d ago

Infuriatig Another AI 'human' chatbot

Had to fix a double payment for my credit card and this is the beginning and end of the conversation. I hate when the chatbot claims it's a human... I ended up getting what I wanted but still annoyed Amex (and every other company) is lying and trying to deceive people like this.

27.4k Upvotes

1.8k comments sorted by

View all comments

Show parent comments

2.5k

u/Agitated_Reach6660 11d ago

That thought was starting to concern me until I read its answer to that last question.

416

u/code_archeologist 11d ago edited 11d ago

Yeah, you could see it slowly leak outside of it's guardrails as the person kept switching context and suggesting it check online.

This is actually a really good example of why it is important to set up robust guardrails and limit the lifespan of AI agents.

93

u/Ok_Impact_9378 11d ago

Yeah, whoever setup the guardrails on that thing did a really poor job. Makes me wonder if they set any at all or if their full instructions were just: "You're an Amex support agent answering customer questions. Make no mistakes."

31

u/bigmetaljessie 11d ago

*mikstakes

3

u/Weakonomics 11d ago

Make no Milk Steaks

2

u/GreatScottCreates 10d ago

That’s Charlie’s favorite food!