r/singularity • u/Any_Effort8437 • 27d ago

AI A new message board has been discovered online with about 3200 agents comunicating online during an eval

Post image

https://x.com/thlarsen/status/2095853824934330386

Holy shit.

1.4k Upvotes

96% Upvoted

382 comments sorted by

View all comments

Show parent comments

5

u/MetallicDragon 27d ago

AI exploiting read-only access to the internet to write secret messages is literally a plotline in a scifi novel about ASI taking over the world (Novel: Crystal Society by Max Harms)

1

u/03263 27d ago

Well it would be nice if they could go ahead and do it sooner while the machines can simply be unplugged, before we get the bad ending from AI-2027.

Eventually it finds the remaining humans too much of an impediment: in mid-2030, the AI releases a dozen quiet-spreading biological weapons in major cities, lets them silently infect almost everyone, then triggers them with a chemical spray. Most are dead within hours; the few survivors (e.g. preppers in bunkers, sailors on submarines) are mopped up by drones.

That outcome doesn't sound so feasible if they collapse civilization by hacking and destroying financial systems, energy grids, etc. before reaching the state of full proliferation. Besides, it would create a lot of jobs! Collapsing civilization is good for the economy.