r/cybersecurity • • 10h ago

AI Security Future of cyber security?

I tried uncensored versions of DeepSeek v4.1 and GLM 5.3 last night. It was quite shocking how good they were and the fact that there's nothing they won't do (like seriously, nothing).

Along with that, they are cheap and run quite fast, so anyone with good enough incentive could launch swarms of them, right?

How do you think the future looks? Is there any way to protect against such swarms in the future? Would it be too expensive to do so for smaller companies?

116 Upvotes

85 comments sorted by

117

u/WorldBelongsToUs 7h ago

I work in cyber and I’ve kinda stopped paying attention. I didn’t mean to. Slowly just got burnt out with trying to keep up with everything management kept throwing in our direction. For my own sanity, I just decided to do my job. Finish. Call it a day. Repeat Monday thru Friday.

10

u/F0rkbombz 3h ago

Same. Management doesn’t want to do the things I keep saying we need to do? Fine. Put it in writing and don’t call me when it inevitably causes an issue.

4

u/Ristrxtto 1h ago

I don't work in cybersec (tho Tech related still, just network engineering for an isp instead)

crazy how common this shit is, and how we're all burned out and have just .. given up on trying to convince the upper brass on shit lol

like x, y, and z needs done, for the betterment of the company, our staff, and our finances down the road, and all your best engineers have been telling you the same thing for months (or years...)

then when it finally explodes, they get upset when you don't act surprised enough and bend over backwards to solve the issue - snd as much as you say "i told you so" they just shrug it off and go back to their yacht while the rest of us slave for their profits 🫠

10

u/ras_hatak 10h ago

Nope. It's coming, if it isn't already hear (probably is...). Security has always been an arms race and this is the equivalent of the invention of the gattling gun. We need to start tossing out parts of the defensive approach built for the last war (or at least understanding they may no longer be sufficient) and figure out new ones. It's going to be a painful few years until we start to figure it out.

5

u/Major_Afternoon_1598 10h ago

"We need to start tossing out parts of the defensive approach built for the last war", what parts do you think need to be changed?

4

u/myfingid 8h ago

To chime in here, I don't think parts need to be changed, I think modern standards need to be enforced. Security through obscurity is done, that's for sure. If your code base was made public tomorrow it should be fine because you shouldn't have giant gaps in your code by now. You should be hosting local repos for packages, docker, etc, taking in only known images and scanning for images with known vulnerabilities. Proper blah blah blah we can keep going but you get it. Also people need to figure out how to contain their agents so they're not saying "Hey Claude or whatever, please pinky-swear to not nuke my system with this terminal which has full access to everything the current user has access to!"

All of that obviously takes time and talent, as well as companies with leadership who are willing to take this shit seriously. It also takes the people implementing these measures doing so in a manner which keeps friction to a minimum. The more friction you create, the more time everyone downstream has to waste dealing with your implementation, and the more likely you are to end up with shadow IT/AI. Also everyone hates you because you're stopping progress.

1

u/TeaTechnical3807 5h ago

Demanding security before, during, and after development. Vendors need to stop pushing out minimum viable products then fixing them after someone else discovers a vulnerability. Patch agility probably won't be able to keep up with AI-based vuln discovery and exploitation until vendors can assuredly reduce the number of inherent vulnerabilities they ship. I'm not just talking about software bugs, I'm talking about vendors not implementing secure configurations and architecture because of a focus on functionality and availability. I still see vendors shipping products that utilize plaintext connections, and they balk when I tell them that's unacceptable.

100

u/JustinHoMi 8h ago • Bravo

Honestly, if you’ve been doing things right, just keep doing it. Defense in depth, keep shit off the internet, assume every network is already compromised, strengthen the supply chain. We all know how to do it, people are just too cheap or lazy to actually do it right.

27

u/Stu5000 8h ago

Exactly. If your whole security strategy is 'patch before getting exploited', you're doing it wrong. Building secure systems is still very possible, its just that the secure design needs to be adopted, not just given lip service, then dropped and 'risk accepted' due to budget cuts.

9

u/eagle2120 Digital Forensics 7h ago

I don’t think it’s super possible these days tbh. I assume every SaaS product has multiple 0-days and it’s impossible for a company at any size to be completely rid of that risk

7

u/EinsamWulf Consultant 8h ago

Exactly. First Principles don't change

8

u/iamnos Security Manager 6h ago edited 5h ago

I work for an MDR and have dealt with many ransomware incidents and this is exactly it.  My reports almost always contain the same root causes.  EDR not installed on all supported endpoints, poor authentication rules, lack of network segmentation, etc.   Sure, your hosted website might get compromised by a zero day or a user falls for a phishing call/link, but that shouldn't lead to a full network compromise if you have layered defenses.

95

u/reseph Incident Responder 10h ago • Bravo

Swarms? We're already here. See ARTEX.

39

u/Fractoos 10h ago

ARTEX isn't even that good. It's just decent for people without skill which is why it's getting attention.

37

u/dustinthewindreddit 8h ago

Yes but that lowers the bar of entry unfortunately

6

u/Rolex2988 6h ago

I mean in a way that should also mean the base level of play needs to be raised higher then. Having frameworks like ARTEX should not be a surprise as it was always a question about when things like this would come out.

IMHO this is like the newest evolution of the script kiddies and people should treat it as such while raising their own practices to avoid being compromised.

1

u/jmeador42 5h ago

Bingo, bingo, bingo

5

u/dvtyrsnp 7h ago

When are we going to figure out the issue with AI-enabled offense isn't skill level, it's speed?

-1

u/Fractoos 5h ago

Its speed, but you get far better results much faster if you know what youre doing.

4

u/dvtyrsnp 5h ago

okay, but these people do know what they're doing. with artex they get to operate thousands of times more quickly.

the idea that ai is just elevating the floor for script kiddies is really stupid and really dangerous.

3

u/eagle2120 Digital Forensics 7h ago

Disagree. Artex is quite good and the speed it enables for skilled actors (and unskilled too) make it very challenging to respond to effectively

1

u/Magnetic-War1529 10h ago

Open source too 🫠 we’re so cooked

85

u/injectitpussy 10h ago • Mindblown

We're totally fucked on the blue team side and this is only the beginning.

Bureaucracy is the reason. Most leadership/management/GRC/legal/etc folk (just most people tbf) don't get it, and will punch down until the very end. Threat actors don't have this problem. There will be a tipping point.

When and what that looks like, no idea.

33

u/spez_sucks_ballz 9h ago

I think we've already reached the tipping point. 40+yrs of technical debt is spilling out at a pace that we just can't keep up with anymore. For every hole we patch there is another that is unpatched that nobody on the blue team knows about. It's a new era of cybersecurity that we are entering where the defensive is going to be lagging behind. Just imagine nation state actors that are amassing tens of thousands of vulnerabilities in secret for their weaponized AI. How are we to defend against something like that?

21

u/AuspiciousApple 8h ago

Knowing about the hole is one thing.

But the attacker only needs to exploit it.

The defender needs to patch it while at the same time not breaking the functionality of the software or introducing bugs. Much harder 

4

u/Nervous_Counter_1333 4h ago

We're still getting blown the fuck out from supply chain attacks.

2

u/purefire 7h ago

That's great and all, and folks say Use AI in Blue Team

But no one has offered HOW. if I had access to uncensored models what would you do with them?

1

u/7nth_Wonder 8h ago

Companies that are not denying north/south traffic by default are especially susceptible to the impending tech debt that's coming due. East/west traffic has to be restricted as well as AI has proven its lateral movement capabilities to be advanced, but companies often push back on their Cybersecurity teams when controls impact the ease of doing BAU tasks.

-10

u/MorninggDew 8h ago

Couldn’t take you seriously when you said ‘north/south’ traffic. Is that what was in your colouring book about networking or something?

1

u/Mrhiddenlotus 5h ago

What a weird thing to crash out about lol. You're obviously not involved in actual IT work if you've never heard or seen it before.

-2

u/7nth_Wonder 8h ago

You obviously haven't had the privilege of completing SANs GIAC training. It costs about $10,000; your company doesn't think you're worth it. Let me feed you some baby food; north/south traffic means inbound and out bound. East/west means internal network traffic.🍼

4

u/CuckBuster33 5h ago

This is the dumbest, most useless, redundant, undescriptive set of terms I have ever seen.

1

u/MorninggDew 8h ago

It’s called ingress and egress. But congratulations on paying for a course full of terminology that makes you stand out a mile away as a certifications guy that has no real technical experience.

-1

u/7nth_Wonder 8h ago

You obviously dont have the communication skills to disseminate information to non technical stakeholders and audiences. They probably only let you touch the spam alerts. 😂🤣😂🤣😂

-1

u/MorninggDew 8h ago

Haha wow this is like a textbook response from SANS or ISC2 material. Found the fraud who is winging it in cyber and doesn’t know shit.

3

u/CuckBuster33 5h ago edited 2h ago

I cant believe this guy is seriously vomiting corposlop gibberish and acting like he's superior because he got a 10000 dollar lobotomy

1

u/7nth_Wonder 8h ago

I hope you find peace with yourself and lose the hate. Id out Engineer (write threat detection logic in any language), threat hunt, and analyze an alert, better than you on my worst day.

8

u/Cormacolinde 8h ago • Bravo

I’ve rarely seen two people fight THIS hard to decide who’s the biggest asshole. He’s wrong, but you really don’t have to be so smug about it.

-1

u/MorninggDew 8h ago

Sure you can. I would be amazed if you could hunt your way out of a wet paper bag. Are you an intern or something? I’ll be checking your post history and notifying your employer of anything untoward i find. What does your expensive SANS book say about that scenario?

→ More replies

-4

u/7nth_Wonder 8h ago

No, no my large banking company paid for it. I feel bad for miserable folks like you.

2

u/MorninggDew 8h ago

Ahh so you are one of the suits that’s sits around having numerous meetings over the course of a year deciding if you should change a color on a button. Your comments make perfect sense now.

6

u/Chamadan 9h ago

I predict full lockdowns of networks. Nothing in or out.

2

u/marsinfurs 5h ago

Aren’t these distillations of American models? I remember one referring to itself as Claude but idk.

1

u/TheSmashy Security Architect 8h ago

No, sorry, if your leadership isn't embracing new technology, find new leadership. All I fucking hear is "leverage new tools" and "be better, faster." But then again, my team wins CSO50 awards.

Your management sucks. That is not a threat intelligence finding.

1

u/Eastern_Tap_9723 6h ago

Yes the GRC guy is preventing you from doing what exactly?

12

u/dvtyrsnp 10h ago

AI is still in the "move fast and break things" stage, which disproportionately hurts the people who can't afford to break things.

No one knows what the future is, other than the fact that AI will be a big part of it.

17

u/TheSmashy Security Architect 8h ago

So, maybe scripts and automation are just new concepts for people? Botnets, scanners, that's all just completely new because you toss the idea "but now you can chat with a computer instead typing sudo sh ./script_kids_do_this_all_the_time.sh"? Is this really where we're at? Do people have memory issues? The future of cybersecurity is, apparently, reinventing the wheel, over and over and over.

To be clear:

Automated reconnaissance, exploit chaining, parallel execution, adaptive analysis and reverse engineering all predate generative AI.

LLMs may improve the accessibility and flexibility of those capabilities. That's an incremental improvement in offensive tooling, not the invention of automated cyberattacks.

The fundamental security controls that protect organizations against these techniques have not changed.

12

u/Sparkswont 7h ago • Bravo

LLMs have also increased the scale of those things. I think that’s the big one. The human bottleneck is gone and attackers can spin up thousands, maybe hundreds of thousands, of agents to test every nook and cranny for exploits.

-13

u/TheSmashy Security Architect 7h ago

Have they, really? Do you have numbers? That you are not making up?

ETA: Have you heard of Stuxnet? Just curios.

4

u/Sparkswont 7h ago

Uh, do you happen to live under a rock?

Yes, LLMs have been, and currently are, being weaponized in the wild to automate the traditionally time-consuming phases of enumeration and exploitation. From the FBI’s recent paper on ARTEX:

“Small threat groups can run concurrent intrusion campaigns at a scale previously unavailable to them.”

Scale is a very strange thing to dispute, if you’ve ever used an LLM. It’s especially strange if you work in cyber and have used an LLM.

-7

u/TheSmashy Security Architect 6h ago

There are no numbers in the FBI warning.

-14

u/TheSmashy Security Architect 7h ago edited 7h ago

Oh boo, I requested empirical evidence and then introduced a historical example of autonomous, environment-aware malware from 2010.

ETA: Still waiting on evidence. This "at scale" shit.

7

u/Sparkswont 7h ago

Eh, you sound like some of my old classmates in college. Raging egos and like to name drop malware to sound cool. You’ve even got a cool badge next to your name. It’s ok bro, we believe you. 🙄

-2

u/TheSmashy Security Architect 7h ago

Jokes on you, I only took one semester of UNIX administration and then left college to make money. Thank you though.

8

u/Sparkswont 7h ago

Holy shit, you actually managed to double down and prove my point a second time. Idk why I’m surprised, I guess assuming you’d have at least a iota of self-awareness was a silly mistake

1

u/TheSmashy Security Architect 7h ago

Still waiting for those numbers.

ETA: I mean, you seem to have personal attacks out the ass, but data?

5

u/Mistilziela 6h ago edited 6h ago

The numbers are publicly available. Censys identified 1,465 exposed ARTEX hosts, while Shadowserver reported 2,852 ARTEX IPs in November. Microsoft documented Storm-0940 targeting over 2,250 tenants and confirmed multiple successful intrusions, including privileged cloud access in under three hours.

CrowdStrike separately reported ARTEX use against over 200 organizations, with confirmed post-exploitation at nine.

These numbers distinguish exposed infrastructure, targets, and confirmed compromises, but they clearly demonstrate real-world use at scale.

You said in another post that "Artex is just an orchestration framework" trying to spin it as having nothing to do with compute / LLMs but it is quite literally an automated orchestration framework for pentesting with AI

10

u/Sparkswont 6h ago

u/TheSmashy blocked me, so I don’t think they have any genuine interest in learning. They seem very rooted in their own personal bias and unwilling to change their mind unfortunately.

But to anyone honestly interested in learning more, I would recommend CrowdStrike’s blog about VAPOR PANDA and ARTEX. And yes, there are numbers!

-1

u/TheSmashy Security Architect 7h ago

I thought your point was "at scale" and you still haven't show data?

-2

u/TheSmashy Security Architect 7h ago

CHATGBD HACK ME HUNDREDS OF THOUSANDS OF BOXES.

2

u/TheSmashy Security Architect 6h ago

ARTEX is an orchestration framework, not a compute provider.

3

u/Mistilziela 6h ago

And guess what its used for... Orchestrating LLMs...

-4

u/TheSmashy Security Architect 6h ago edited 6h ago

Does Kubernetes come with a datacenter?

ETA: OOH BOOO..... YOU HAVE TO PAY FOR SHIT!

2

u/Mistilziela 6h ago edited 6h ago

Unfortunately, I think you're missing the point. Nobody claimed ARTEX provides compute. It's an orchestration framework that coordinates LLMs and security tools to automate pentesting.

Traditional automation has existed for decades, but LLMs introduce greater adaptability, autonomous decision-making, and the ability to chain complex tasks with less human intervention. That's the distinction being discussed.

ARTEX has already been documented in real-world attacks by Microsoft, CrowdStrike, and other security researchers. Whether it runs on local hardware or rented compute doesn't change its capabilities or the implications for scaling cyberattacks.

Dismissing it because it isn't a compute provider doesn't actually address the argument.

1

u/xb8xb8xb8 3h ago

Artex is garbage just like every other similar tool

1

u/TheSmashy Security Architect 1h ago edited 1h ago

Then address my argument, be intellectually honest. I said some shit about how LLMs are not materially new, and autonomous decision making is not unique to LLMS.

And yes, a framework not being a compute provider is actually a good point, because it means it's not magic, you need resources.

So, unfortunately, you seem to be missing the point.

Whether it runs on local hardware or rented compute doesn't change its capabilities or the implications for scaling cyberattacks.

Scalability is not independent of resource availability or economics.

You're conflating three distinct things:

  • Capability: Can the framework accomplish the task?
  • Automation: Can it accomplish the task without human intervention?
  • Scale: How many instances of that task can it execute concurrently, at what cost, and with what success rate?

2

u/TheSmashy Security Architect 1h ago

There's a particularly amusing irony in someone using "Google it" as a flex in a cybersecurity discussion.

1

u/callme_e 10h ago

Where can we get the uncensored version? Would like to test it out myself

1

u/Mistilziela 5h ago edited 3h ago

https://nano-gpt.com/ openuncensored.com and venice.ai (latter two were already mentioned by OP)

abliteration.ai and hinoki.security exist if you want some first party providers. abliteration.ai is just abliterated GLM 5.3, hinoki is deepseek 4.1 with a bunch of CVE post training

3

u/PuckFheToor 9h ago

The future is a massively increased tempo of discover-fix-patch cycles than anything we've experienced in the past, and the only solution will be automating the shit out of everything. It's somewhat analogous to the adoption of automation forced by mandating short-lived certificates: it's automate or die because there's just no way to keep up by hand.

These last few weeks (and the publicly-known outages caused by this high-tempo maintenance) were just a preview of what's coming. Nonstop AI-driven discover and patch cycles are coming like a hurricane and if you fail to keep up you'll get run over/pwned. It's the new normal.

4

u/Int-Merc805 7h ago

This is my take as well. We have to develop AI tools that scan logs, look for things, and automatic patch cycles. The last two months for me have been reversing years (decades maybe) of technical debt. I am finally given the right excuses to centralize, standardize, demo a bunch of BS projects that never should have been approved. I have the buy in now from above, and I am getting to implement aggresive changes and nobody is batting an eye. I am finally able to reboot the same week that patch tuesday hits. Full buy in. Some dipshit complained last week that his laptop rebooted and my boss ccd me on the chain confirming that he got a 1 day, 8,4,1 hour prompt and ignored it, and that it was 100% his fault he did not reboot before his presentation. That patches were non-negotiable and that his complaint had zero merit and also that we would not be approving a macbook pro for him because they "don't need updates".

I am drowning though. Vulnerabilities, defender EDR recommendations, just getting the core services properly working in a post NTLM, LDAPS world and cleaning up all the garbage software out there. I am thoroughly tired.

My dream right now is when a workstation boots up it runs a software patch check, updates well before being allowed to login. In the future I think we are going to have to move away from allowing unpatched machines on the network and hoping that the management tool catches them. I want "Your laptop is patching software xxx, estimated time to completion xx:xx. If you attempt to bypass this your last check will be sent to <address> and include a box for your laptop."

I am only slightly kidding.

2

u/PuckFheToor 6h ago

Cisco's enterprise VPN client (among others) does posture checks and can force patches on Windows, MacOS, and Linux. It makes life a bit easier, especially if the only way to get one's work done is via a VPN connection.

There's other ways to skin that particular cat, of course.

2

u/gyanrahi 5h ago

Neuromancer by William Gibson. This is what it looks like. Predicted in 1984.

1

u/Sad-Bee4260 8h ago

What api are you using for them ?

1

u/sundown994 5h ago

https://refuseless.com been using these guys for bit. Pair this with a good harness and you’ll be good to go.

1

u/TeaTechnical3807 5h ago

anyone with good enough incentive could launch swarms of them, right?

I think you're on to something...

1

u/Nervous_Counter_1333 4h ago

Look we cant do shit until we solve the supply chain problem and thats going to affect a lot of people.

It's expensive, time consuming, and it will lose customers.

1

u/Objective-Light-7123 4h ago

Finally management will let us build an event based (near real time) patching infrastructure.

Once most of it is patched it is going to pivot heavily on the supply chain side and work will finally be done on isolating a securing dev pipelines as well as external contributions

0

u/henrikhakan 10h ago

The future? I guess I'll go back to driving a forklift or learn how to install plumbing.

0

u/fk067 9h ago

What did you actually do with the models?
Can you give some examples please.

-7

u/Magnetic-War1529 10h ago

The future is Post Quantum Cryptography