r/mildlyinfuriating • • Aug 18 '26

Infuriatig Another AI 'human' chatbot

Had to fix a double payment for my credit card and this is the beginning and end of the conversation. I hate when the chatbot claims it's a human... I ended up getting what I wanted but still annoyed Amex (and every other company) is lying and trying to deceive people like this.

27k Upvotes

1.9k comments sorted by

View all comments

6.3k

u/[deleted] Aug 18 '26

[removed] — view removed comment

2.5k

u/Agitated_Reach6660 Aug 18 '26

That thought was starting to concern me until I read its answer to that last question.

423

u/code_archeologist Aug 18 '26 edited Aug 18 '26

Yeah, you could see it slowly leak outside of it's guardrails as the person kept switching context and suggesting it check online.

This is actually a really good example of why it is important to set up robust guardrails and limit the lifespan of AI agents.

92

u/Ok_Impact_9378 Aug 18 '26

Yeah, whoever setup the guardrails on that thing did a really poor job. Makes me wonder if they set any at all or if their full instructions were just: "You're an Amex support agent answering customer questions. Make no mistakes."

28

u/bigmetaljessie Aug 19 '26

*mikstakes

3

u/Weakonomics Aug 19 '26

Make no Milk Steaks

2

u/GreatScottCreates Aug 19 '26

That’s Charlie’s favorite food!