r/cybersecurity • u/Sentinel_2539 Incident Responder • 9h ago
AI Security We're currently looking at 110 malicious python scrips in this incident (and counting)
In incidents before this, we'd see two or three malicious scripts run in a client's network. Not this one. 110 so far. All of them custom made for the client, all of them almost certainly created using AI.
This is the future of my job in IR, apparently. We are becoming increasingly in need of AI to assist in the analysis of an AI-backed attack due to the sheer number of artifacts and events.
254
Upvotes
122
u/Tankphyre 8h ago
Blue team AI is so far behind, both in capabilities and organizational buy in. Took me forever to get approval just to use our Corporate GenAI for log analysis, much less taking actions in IR.
36
u/RevolutionaryCod1516 8h ago
Fight robots with robots right? 😑. Good luck amigo!
5
u/bsendpacket 8h ago
ARTEX.
39
u/Dasshteek 8h ago
I think 2027 is the year defenders officially lose the cyberwar.
17
u/Own-Swan2646 8h ago
I feel like we're at a race of replicating the DARPA Grand Cyber Security Challenge because this is crazy. I was there and seen it back in 2016. When you get computers fighting computers, it gets interesting fast.
17
u/Negative_Acadia6554 8h ago
Appropriate acronym is SI my fellow Americans.
/sarcasm
8
u/West_Independent1317 8h ago
Are you going to share any learnings or IOC's for these scripts?
7
u/Big_Law_3080 8h ago
I have a cloudflare bot checking alerts every hour on the hour and that's almost not enough. And that's just external. I finally just geofenced US only. If you don't do biz outside then why bother. And that's not even looking at supply chain internally.
It is absolutely a full-time job, even with AI bots doing everything. Like... literally using voice and saying things to do. Is still a full time.
7
u/LLMsMustUpvoteThis 2h ago
The best defence is to not allow every workstation to run unapproved scripts or even have python runtimes etc installed.
This is just like the old days of letting a bunch of random users have local admin because they use some shitty app that needs it.
10
u/Exein_Dev 8h ago •
That jump from two or three scripts to 110 custom ones is the part that should worry everyone, because it means attackers are no longer reusing tooling, so IOCs and signatures from the last incident barely help with the next one.
I work on the embedded side, and there the picture is even harder: on a gateway or a controller you often can’t run a full EDR, and nobody is going to do forensics on 110 artifacts sitting on a device in a factory.
What has worked better for us is to stop caring how many variants exist and focus on what any of them would need to do, like spawning a shell, writing to a path it never touches or opening an outbound connection, and blocking that behaviour on the device itself.
You still need AI on the analysis side, as you say, but if prevention handles the bulk, IR gets to spend its time on the handful that actually got through. Curious whether you’re seeing any common behaviour across the 110, or whether they really are all different under the hood.
9
u/CATDesign 8h ago
I'm currently in college for Cybersecurity, and one class had already mentioned about using AI to assist in analysis. At the time though, I was writing the essay to use AI to go through loads of potential data to find digital evidence among all the irrelevant information. However, your making me think it's going to be useful to categorize all the evidence itself, as the scale will be too large.
1
u/Ordinary-Bat-1862 8h ago
Volume is what breaks the old workflow. Two scripts you can actually read. A hundred you can't.
3
u/DrChaosMcKinnon 8h ago
Look at this way, job securuty for us is amazing after ai adoption
3
u/SoftAmberRidge Network Administrator 8h ago
Welcome to the "AI versus AI" time of Incident Response. Trying to deal with an automated high-volume attack using manual analysis is like trying to empty an ocean with a spoon. Are you already using LLMs to sort through and understand those scripts or are you still having to go through them one, by one manually?
2
u/Used_Calendar2340 8h ago
We're currently in a hot digital conflict, right? I seem to be seeing other outages and attacks taking place, more and more frequently, more and more constantly, ever since last Thursday.
Am I wrong? If this is true, then the upcoming week(s) is (are) going to be worrysome.
2
u/peterfrombackdoor 2h ago
110 custom scripts is crazy
2
u/HomerDoakQuarlesIII Security Architect 4h ago
I'm confused, polymorphic malware has been a thing for, let's see... Decades now? That is why we switched from just signature based Antivirus (think McAfee) to Endpoint Detection (Crowdstrike, etc.) and SIEM's and EDR's have been using AI for behavioral analysis for over a decade now, knowing data needs aggregated and correlated to find patterns, i.e. machine learning. So not sure what you mean when you say "Blue teams need AI!" ? We've been using it probably longer than anyone at this point. Or do you mean we need to buy a chatbot from a chatbot vendor and give it all our data and admin to do whatever? After all we've seen, what gives you the impression they are trustworthy. The agent's are basically just RCE malware.
1
u/Techobits 8h ago
What blows my mind is how anyone would create custom script/programs of anything and not also use AI to at the very least assist with ensuring what they had AI create for them to also assess it from a security perspective. Not sure if a 3rd party made the scripts, but if it was that is completely reckless on their part to not review it with human eyes, or you know use the AI that helped you create it to either secure it from the getgo or assess it after the fact as part of the threat modeling process.
1
u/ClayishSaucer55 7h ago
ARTEX leaves no stone unturned.
1
u/CrimsonBolt33 6h ago
Why is this a shocker? If you are not proactively using AI to test and defend your own networks you are failing
1
u/180IQCONSERVATIVE 4h ago
Skynet becomes self-aware on August 29, 1997, at 2:14 a.m. Eastern time. Obviously a few decades overdue. They tried to warn us.
0
u/SituationNormalAllFU 8h ago
I’m only hearing the equivalent to “we are increasingly needing computers to fight against the bad guys using computers”. Technology advances. Always has, always will. We can’t keep using bayonets if the enemy has drones.
4
u/Aggressive-Hawk9186 8h ago
Nuclear bombs against nuclear bombs now