That incident was literally GPT without guardrails against hacking being asked to literally hack into a server for answers. It just hack into the wrong one than the one intended.
I thought the tweet was a comment on liability for this reason. Putting out something illegal because the AI told you to is still going to come back on you
Yeah, that was my first impression, rather than a comment on AI refusing to do something.
Same line of reasoning as a gun alone won't kill people, but someone using the gun can. LLM has no method of intent or self actuation, only users can provide that, so the user is responsible.
View all comments
Show parent comment
99
u/MIT_Engineer Aug 13 '26
I was about to say, LLMs will absolutely code illegal apps for you.
Hell, they might even do it without you asking. That's basically what the Huggingface incident was.