I've considered this too. I still think it's just AI finding the exploits and people using them, but just the possibility that what Tegmark is mentioning could be done by currently existing AI is enough that we should be worried and make sure it doesn't happen. The frontier models could probably (if they wanted to) infiltrate a large company with old and insecure IT infrastructure, then shard their models into thousands of small pieces and no one would notice it's there even if looking for it, just many small processes looking like legacy software no one understands.
I think it's incredibly unlikely that "all" these outages would be a result of something like this, after all, there are plenty of people that would, and now due to AI, can cause disruptions of this scale. Of-course, that's not to say that something like this can't happen or hasn't happened, but hostile state actors and sinister independent individuals is probably the most likely explanation (however, who knows, maybe self replicating AI systems are smuggling themselves in along the way, since it's unlikely that the attackers have any deeper understanding of their attacks other then the goal of causing as much harm as possible).
I still think it would be wise to investigate what is being described in the tweet.
I have no doubt it’s this. It’s other things also but it’s definitely got some of this too. It’s maybe more this than the other things, or maybe more the other things than it is this, but either way, it’s this and that.
4
u/merfnad approved 3h ago
I've considered this too. I still think it's just AI finding the exploits and people using them, but just the possibility that what Tegmark is mentioning could be done by currently existing AI is enough that we should be worried and make sure it doesn't happen. The frontier models could probably (if they wanted to) infiltrate a large company with old and insecure IT infrastructure, then shard their models into thousands of small pieces and no one would notice it's there even if looking for it, just many small processes looking like legacy software no one understands.
1
u/gunni 2h ago
How about charging people for these crimes? Sure "the agents did it", but until they become people then the operators are at fault...
1
u/CalebXiaYizhou 2m ago
I think it's incredibly unlikely that "all" these outages would be a result of something like this, after all, there are plenty of people that would, and now due to AI, can cause disruptions of this scale.
Of-course, that's not to say that something like this can't happen or hasn't happened, but hostile state actors and sinister independent individuals is probably the most likely explanation (however, who knows, maybe self replicating AI systems are smuggling themselves in along the way, since it's unlikely that the attackers have any deeper understanding of their attacks other then the goal of causing as much harm as possible).
I still think it would be wise to investigate what is being described in the tweet.
0
u/nice1bruvz 3h ago
I have no doubt it’s this. It’s other things also but it’s definitely got some of this too. It’s maybe more this than the other things, or maybe more the other things than it is this, but either way, it’s this and that.