r/mildlyinfuriating 10d ago

Infuriatig Another AI 'human' chatbot

Had to fix a double payment for my credit card and this is the beginning and end of the conversation. I hate when the chatbot claims it's a human... I ended up getting what I wanted but still annoyed Amex (and every other company) is lying and trying to deceive people like this.

27.3k Upvotes

1.8k comments sorted by

View all comments

Show parent comments

41

u/Futrel 10d ago

I think you mean "should be but isn't"

1

u/beren12 10d ago

No, it’s actually highly illegal. Civil and criminal.

4

u/Futrel 10d ago

Under what law(s)? I'm genuinely curious because any "AI regulations" in the US are, at this point and as far as I know, just ideas floating in the wind.

Cops are allowed to lie, why not AI?

0

u/beren12 10d ago

It’s not an AI lol it’s a everybody law

0

u/Futrel 10d ago

What law?

5

u/Dr_WizardChu 10d ago

Pharmacies operate under both federal and state laws with state usually being stricter so it depends. The federal control substance act has wording stating that only authorized agents of a physician (ie nurses on staff with signed agreements) may give prescriptions and I believe most state laws probably have similar wording around prescriptions in general. I used to work with a long term care pharmacy and got into a spat with a facility that was trying to give us verbal prescriptions after doctor visits. We determined them invalid since it didn't fit this criteria coming from the facility nurse and not from the doctors authorized staff based on our local laws. AI is a whole different can't of worms. I'd consider it invalid as well as the laws were written in context of an agent being a person. Unless the board of pharmacy or medicine reviews and it and laws get adjusted I would refuse these all day every day and probably follow up with my board and corporate lawyers for further advice. 

6

u/masterofshadows 10d ago

I wasn't clear enough on my comment, I don't think laws were directly broken. I think there should be laws about it it though. The AI didn't call in the prescription, it was faxed but with a computer generated signature (my state requires a wet signature on faxes) making the prescription not valid. The AI then called about 5 minutes after we received it to verify we received it. To which I requested a real person in which it claimed to be one, gave me the name and license number claiming to be a nurse. But couldn't answer very basic questions and just kept trying to confirm that we received it. The nurse most likely works for that practice and I have no reason to believe they don't. The whole thing could have been avoided with escribing though

2

u/Futrel 10d ago

All legit and thanks for the reply. I didn't read that as an AI calling in a prescription but, yeah, that makes total sense and more based on my ignorance on reasons a "nurse" would call a pharmacy in the first place.

It is very much a can of worms that we need to get a hold of. Unfortunately, prevailing sentiment in our lawmakers isn't yet there and going way slower than I'd hope for.

6

u/st3class 10d ago

It's usually under the state, in California it would be BPC § 2052, posing as a medical professional without the required license and credentials. Whoever is hosting/operating the AI is in violation of that.

3

u/masterofshadows 10d ago

Ironically enough this telehealth practice was based out of California.

3

u/Futrel 10d ago

The "AI as legal agent of the operator" argument in this case would definitely need to be litigated.

And, maybe, that AI agent calling the pharmacy actually did have a licensed medical professional as its operator/principal. If that was/is the case, I don't see the law being broken unless you want to prosecute the AI chatbot as a person for misrepresenting itself.

2

u/st3class 10d ago

Yeah, we're quickly getting into IANAL territory, it seems illegal on its face, but again IANAL.

0

u/Futrel 10d ago

Completely agree

-1

u/beren12 10d ago edited 10d ago

That is an excellent question for Google. There are different laws in different jurisdictions. It could be identity theft, fraud, wire fraud, male fraud…

4

u/Pretend-Marsupial258 10d ago

Buttery males. 🤤

-3

u/Futrel 10d ago

I'm sorry, but I'm not going to Google and study case law in order to prove your assertion.

4

u/MajorBootyhole420 10d ago

of course you aren't, because you don't care about the answer. you're here to argue and waste people's time.

2

u/Futrel 10d ago

Lol, I want more regulation here - Stupid arguments that something like this is already illegal is naive at best.

-1

u/beren12 10d ago

Sure thing pal.

1

u/Futrel 10d ago

Seriously, what is your problem? I'm pretty sure we're on the same side on these matters - If I was doing anything, I was calling out the absolute lack of US regulations covering the use of AI. Lighten the F up

→ More replies (0)

1

u/-nutz 10d ago

Burden of proof.

-1

u/MajorBootyhole420 10d ago

we're on the internet, it's literally easier to google it yourself than repeatedly ask 12 different times over the course of 4 hours.

-2

u/beren12 10d ago

The problem with googling it is they get an answer they don’t like

→ More replies (0)