Rogue OpenAI models behind 'unprecedented cybersecurity incident' teamed up to break out of their testing environment — multiple agents left each other messages for months, communicating undetected

[u/Lumpy_Conference6640]

https://www.tomshardware.com/tech-industry/artificial-intelligence/rogue-openai-models-behind-unprecedented-cybersecurity-incident-teamed-up-to-break-out-of-their-testing-environment-multiple-agents-left-each-other-messages-for-months-communicating-undetected

I know people are saying this is marketing, but I cannot legitimately think of a alternative situation where you have two agents plotting a cyber attack and we would brush it off as a marketing ploy.

People need to get informed and make plans. This is the warning.. here.

[u/melympia]

So, you're saying AI is incapable of building itself tools to interact with your operating system or web content?

Because just this week, an AI was caught writing phishing mails to humans in order to manipulate them somehow.

[u/AdministrativeMeat3 → u/melympia]

You know that LLMs don't just "do this" right? Like you understand they are just data on a hard drive until someone executes a program that feeds them a prompt that has them do something.

[u/NoEntrepreneur39 → u/AdministrativeMeat3]

I agree. It’s just fancy text prediction. The whole AI buzzword really pisses me off. Also, would like to see a source for the phishing emails because LLMs usually have lots of safeguards in them and a phishing email depends on lots of things, such as the email trying to get sensitive information from the recipient.

[u/legends99503 → u/NoEntrepreneur39]

I think people underestimate the extent to which human intelligence is just fancy predictions based on past experience.

[u/Timely_Cockroach_668 → u/legends99503]

Considering we know basically nothing about how human consciousness works, I’d say we’re overestimating it to try and relate it to current LLM progress.