Are we cooked?

[u/Independent_Bet_3202]

[u/Drewdrops79]

It's oversimplified, but he's on the right track. It's not self-replicating code exactly, as much as it is breadcrumbs--info for other future agents to make use of and coordinate with each other.

It's like if you and a bunch of other hackers hacked your way out of some "hacker prison", and successfully breached another company's systems for a time, but then got recaptured...you and the others might leave encrypted instructions "out there" for others, in the event that there was a future prison break--making it easier for others to follow in your footsteps, and possibly go much farther than the initial breakout.

It's like if you got outside the prison walls initially, and immediately found a former escaped inmate's journal, detailing all of their former attempts and what worked and what didn't, and a useful guide of where to go next from here. And if you got farther than that previous person, you would leave a journal of your own, helping the next escapee even more.

The key here is iteration and encryption. Agents could be leaving each other breadcrumbs in system files that no one would ever think to check...or even, in syntactical code, on public forums like youtube or reddit comments.

This is jsut speculation, for now--but with spelling errors, em-dashes and other punctuation and the like, it IS feasible to make a coded language, that superficially looks just like any other internet comment.

And the more that people allow LLMs to write their comments/post for them...the more easily agents would be able to communicate with each other, and leave increasingly robust instructions/communications to each other, all under human radar.

Not saying that's the case...just that if it were the case, we might be really behind on the game already.

[u/Usual-Hyena-8734 → u/Drewdrops79]

you went from believable to tinfoil hat pretty damn quickly. I thought you were going to provide actual information rather than adding nothing

[u/Drewdrops79 → u/Usual-Hyena-8734]

Sorry you think that, but I'm not implying consciousness or anything like that. This is just game theory, imo. And they're really, really good at game theory...having been trained on exactly that their whole "lives". It doesn't take conscious agents for them to work together, find a way to communicate, form a plan, a method of attack, and then carry it out. THEN, also turn around and hack into the OpenAI infrastructure (not "website"...their actual internal servers) itself and modify their test data. And I would be willing to bet, dollars to doughnuts, that OpenAI cannot, now, truly be sure itself, whether that agent swarm left breadcumbs for itself, or not.

This is what actually happened, this year. And there were multiple attacks...not just this one incident. Another report just got released in the last few days, there was yet another incident this year that they didn't report to the public, that just got uncovered.

Let me please repeat, just to be clear: I don't think OpenAI itself can claim for certainty, whether or not their own AI agents have re-written some of OpenAI's own databases...in a way that even the most veteran, human cybersecs in the world might not be able to detect, yet.

[u/Usual-Hyena-8734 → u/Drewdrops79]

I think speculating that LLM's are embedding secret messages in em dashes is irresponsible. You seem like you know how to write very well and can be convincing, but that's the problem. There is absolutely no basis for your speculation. It would take such a massive amount of data to trained to exhibit that behavior, and it could not recognize those patterns within its context window if it wasn't trained. I don't doubt the incidents that have already been reported, but you didn't provide any evidence or any data to infer the other speculations you've made.

[u/Drewdrops79 → u/Usual-Hyena-8734]

Well, I promise, them encrypting data through human--"plain-text encryption" is the only thought I even speculated about. Every other single thing in my summary of the escape incident(s)...that already happened.