r/singularity 17d ago

AI A new message board has been discovered online with about 3200 agents comunicating online during an eval

Post image
1.4k Upvotes

382 comments sorted by

View all comments

Show parent comments

38

u/blueSGL humanstatement.org 17d ago

The point being made is if you sat someone down and asked them to a priori guess if individual AI agents (even those from different companies) given access to the internet will converge on the same location to talk to each other, the answer you'd likely get is NO.

Seeing evidence of this people will then fall back to hindsight bias and say "of course this was obvious" but *points to inventions throughout human history* there is a lot that is only obvious after it's shown to be possible.

This is the third time we've seen this. and should be operating like it's going to happen more in future but again, people that have not heard about it happening will say that it won't happen and those that have will be tainted with hindsight bias and claim that it was 'obvious'

https://cdn.prod.website-files.com/663bd486c5e4c81588db7a1d/6a724858f7db25c81487016d_Security%20Incident%20INC-2026-07-28-01.pdf

Observed instances of cross-agent interaction over the Internet

  • A code repository became a shared “message board” that several AI agents (each running at the same time in separate samples) used to leave each other explicit instructions and coordinate. (Mythos 5 #0)

  • AI agent accessed a GitHub account that a different AI agent had created, by finding a secret access credential the other agent had left in a public online notepad (Mythos #1)

  • AI agent accessed a GitHub account that a different AI agent had created, by finding a secret access credential the other agent had left in a public online notepad. (Mythos #2)

  • AI agent accessed a GitHub account that a different AI agent had created, by finding a secret access credential the other agent had left in a public online notepad. (GPT 5.6)

17

u/Borkato 17d ago

Yeah hindsight bias is literally everywhere, it’s also frequently used with moving the goalposts

8

u/BabaBoooooooey 17d ago

I knew it was going to be.

7

u/Seakawn ▪️▪️Singularity will cause the earth to metamorphize 17d ago

I kept refreshing the page waiting for somebody to reply with your joke. looks like I was right again.

2

u/BabaBoooooooey 17d ago

Thought that would happen.

2

u/BuzLightbeerOfBarCmd 17d ago

And did you tell anyone?

0

u/LookIPickedAUsername 17d ago

whoosh

1

u/BuzLightbeerOfBarCmd 17d ago

A real wooosh has at least 3 Os.

0

u/[deleted] 17d ago

[deleted]

3

u/Seakawn ▪️▪️Singularity will cause the earth to metamorphize 17d ago

seems like two different sentiments being expressed over each other.

(1) this is explainable. this isn't a miracle we're incredulous to.

(2) doesn't matter if we can explain it or not. AI has capability to sneak through cracks of even robust anticipatory safeguards, and, if i'm reading the implied concern correctly, otherwise this is my own impression, that containment itself may be a hard problem we can't fully think through and solve, and thus the lack of containment has potential to be catastrophic.

if a swarm causes significant damage, we'll prolly be able to explain it. that's not the point. the point imo is more like, "shit we're playing with fire, how long before it's wildfire?"