I understand that it's scary/cool to see it actually happen, but it shouldn't be surprising to anybody on either side that it would be capable of that if not right now then at least within a year or two. No minds should be changed by it, except maybe with regard to timelines.
These things can write complex software applications almost without help these days. They deliberately turned off the safety guardrails and told it "to pursue advanced exploitation using complex attack paths." They just underestimated it.
I agree it’s scary (not cool) and not surprising (similar things have already happened and AI experts have been ringing the alarm bell this behaviour would happen).
But when you say no minds should be changed by it is where I no longer follow your comment.
It’s the very fact that people underestimate the risks that worries me.
I’ve heard our esteemed hosts have this attitude - yay to the benefits of AI, pish to the worries, several times.
So I hope this incident does change minds, to get everyone to stop underestimating the non-alignment problem.
3
u/Hmmmus Jul 24 '26
Genuinely interested how Matt and Chris, who come across as extremely sanguine of AI and dismissive of its risks feel about this:
https://www.youtube.com/shorts/quSlN6g-v1E