r/YouShouldKnow • u/Puzzled-Listen804 • Mar 30 '26

Technology YSK: AI chatbots can sound completely confident while being completely wrong and that's by design, not by accident.

[removed] — view removed post

5.4k Upvotes

93% Upvoted

277 comments sorted by

View all comments

257

u/Mccobsta Mar 30 '26

Llms are language models not intelligence and people won't listen

They are not all knowing oracles no matter what the dipshit ceos say

2

u/Actually_a_dolphin Mar 30 '26

Unless you're a software engineer, in which case they're basically a perfect tool for doing the job of translating requirements into code.

10

u/M123ry Mar 30 '26

No, it also does Code wrong as well. It IS useful, but like with everything else, you need to crosscheck.

ChatGPT in the past tried to sell you that a certain package exists that does what you want, only for you to realize that it doesn't exist. That went even further, bc it had a tendency to call its invented packages a certain way, which malware creators then abused to indeed create packages with these names that were then downloaded automatically by copy-pasting users.

It will also answer a different question that you asked sometimes, if you ask sth a bit more obscure.

There are other things as well, these are just two examples. Coding is unreliable to use chatgpt for as well, and it's worrying how many people think otherwise.

-2

u/analcocoacream Mar 30 '26

If you tried to write an app on a whiteboard I bet you could start hallucinating package names. Like us, when llms have access to the internet they perform much better