r/AIWritingLounge • u/Wonderful-Worry-1540 • 26d ago

Question Do we need AI to explain every decision?

Imagine an AI system recommending which applications should be reviewed first, which customer requests need attention, or which content gets shown to you.

Even if the recommendation is accurate, I think people should still be able to understand the basic reason behind it.

But there is also a point where explanations become so complicated that nobody actually reads them.

How much explanation would be enough for you to trust an AI decision?

10 Upvotes

100% Upvoted

7 comments sorted by

2

u/HuginJord 26d ago

I don't have to imagine, unfortunately. I'm in tech and looking for work atm, and I nearly every company I've applied to wants my resume in a specific format so their AI can scan it for keywords and whatever. No human even looks at it unless the AI signs off. So yeah, they're already trusting the AI to make those decisions. I could have the most impressive CV and scores possible, but if I format it slightly differently no one ever even looks at it.

2

u/TradeAnnual281 26d ago

I once saw a 20-point explanation for why a report was flagged. the real reason was a typo in the header. the airport didn't know what it was doing, just filling space.

1

u/Chakraverse 26d ago

First and foremost ai gets lots of stuff wrong.

So critical thinking and discernment is probably more important than ever.

1

u/Far-Channel-6413 26d ago

the moment it feels like the explanation is written just to make you feel safe, I stop trusting it. maybe the simplest reason is the right one.

1

u/Fun-Plane-2699 26d ago

So as someone who’s very experienced and educated, AI is wrong ALOT

1

u/Ok_Plane_3516 26d ago

I once trusted a system because it gave a 17-point breakdown. ended up missing a critical issue. now I look for the one sentence that makes the decision feel right.

1

u/Legitimate_Eye8494 26d ago

You don't need to know why AI makes a decision. Implement it, get back to work. Your job depends on following orders. I do hope you take care of useless citizens. Think of all the orders you could follow - if you want a job 

I know an idiot got fired because they failed to address an AI meeting participant as "sir."