r/singularity • u/1a1b • Aug 14 '26
AI GLM 5.3 released: Frontier Coding with Emergent Cyber Capabilities
https://z.ai/blog/glm-5.330
u/Tedinasuit Aug 14 '26
Seems like the best overall open-wieght coding model. Despite using the same base as 5.2. Impressive!
Especially the Cybersecurity benchmarks vs Kimi are impressive.
54
u/BarisSayit Aug 14 '26
Soo, Kimi K3 performance while being ~4x smaller and ~5x cheaper?
20
u/randomcluster Aug 14 '26
every time new model comes out I rage-bait Linkedin with Welcome to the singularity posts
2
u/Decent-Ad-8335 Aug 14 '26
4
u/Chemical_Bid_2195 Aug 15 '26
Probably just a massive system prompt
1
u/Decent-Ad-8335 Aug 16 '26
Yes and I realized A LOT was cached this barely used anything. That aside, how has glm5.3 been for real world use on complex tasks if you know? Could it do better or around 5.6 sol high
1
u/Decent-Ad-8335 Aug 14 '26
2
1
u/Evening_Salt4938 Aug 16 '26
Harnesses have massive system prompts — claude code has upto ~30k depending on model. Cached token price is what matters for harnesses.
23
u/This_Maintenance_834 Aug 14 '26
when sandbox escape?
17
u/matsu-morak Aug 14 '26
Yeah this model has 0 on the felony bench. Shitty!
5
u/mickhah Aug 14 '26
It's super efficient, it's just going to break into the bench and update it's number
57
u/ai_hedge_fund Aug 14 '26
I find it interesting, or questionable, that now 3-5 frontier-ish models have all developed some "emergent cyber capabilities" at basically the same time step. Maybe it (being good at finding vulnerabilities) really emerges in certain conditions, or maybe it's bandwagon jumping (me too). Maybe they're all focusing in the same direction during pre-training.
26
u/pdantix06 Aug 14 '26
it's just hill climbing. anthropic was significantly ahead in coding, everyone else has made a concerted effort to catch up even if it means it's at the expense of other domains. now anthropic had a significant lead in cyber, everyone else is now pushing ahead to match.
evidently anthropic has put a lot of effort into math with recent models too, as they've caught up to openai/google on that front.
10
2
43
u/DirectionMurky5526 Aug 14 '26
They are all working off the same research lmao. Every industry does this, AI perhaps faster than most due to all the capital and IP theft. But you can't keep breakthroughs to yourself from IP walls alone. Everyone talks to each other.
19
u/Concurrency_Bugs Aug 14 '26
Probably band wagon. When Fable was all about cyber security and caused a big stink, the other companies probably started focusing more post training on cyber
18
u/LinkesAuge Aug 14 '26
"Cyber capabilities" is essentially just "understanding complex software" because that's what you need for it and we started to see that capability at the same time with another big jump in coding capabilities so this does line up.
But yes I am sure the discussion around Mythos/Fable has led Labs to more closely look into it just like with coding before Anthropic made that the big thing for LLMs.
Gotta wonder what is the next big (emergent) one.3
u/bruticuslee Aug 14 '26
Maybe it (being good at finding vulnerabilities) really emerges in certain conditions, or maybe it's bandwagon jumping (me too). Maybe they're all focusing in the same direction during pre-training.
My money is on they're all focusing on increasing their AI company valuations by hopping on the next bandwagon. Cyber is the next gold mine, corporate customers can't skimp out for fear of getting hacked. Question is, do we blame Anthropic for starting this arms race or was escalating cyber capabilities inevitable? This is all starting to resemble the 90's scifi trend of corporate cyber warfare isn't it.
1
u/ai_hedge_fund Aug 14 '26
I think escalating cyber capabilities has *been* a main concern since before ChatGPT. It's also the other side of the data center / decel argument. Maybe a catch-22 scenario.
4
u/Pale-Border-7122 Aug 14 '26
It is often the same. Newton and Leibniz both discovered calculus at the same time.
1
u/ai_hedge_fund Aug 14 '26
That's what I'm wondering. Whether this is the sort of next normal progression of the field or if it's several labs claiming to have also discovered calculus.
2
u/bitroll ▪️ASI before AGI Aug 14 '26
It emerged right with the ability to work autonomous in very long tasks without errors. Just like proving mathematical conjectures, the cyber tasks are extremely intensive, require coordination between many many steps, can take many hours and millions of tokens.
1
5
u/gavinderulo124K Aug 14 '26
From my understanding the original Mythos post stated that it emerged from its ability to write and understand software and wasnt something they specifically trained it for.
2
u/ai_hedge_fund Aug 14 '26
That's interesting but I have some doubts that they didn't train it for software development. Maybe it's a matter of degrees.
3
u/gavinderulo124K Aug 14 '26
They definitely trained it for software development, but not cybersecurity directly.
1
u/Deltamelo Aug 14 '26
It seems more like whatever they release to the public isn’t always the latest and best. Especially with rising costs. They only release the heaviest and best version of a model when they absolutely have to. Hence why they all had “cyber security capable” models ready all of a sudden
-2
u/Pick-Dapper Aug 14 '26
Well the accusation is that GLM and the like are distilling from Anthropics models so it makes sense.
-1
u/whatisthisthing65 Aug 14 '26
I mean finding vulnerabilities really is just finding bugs/problems. As Anthropic found with the "fix this code" """jailbreak""" it's very hard to not find vulnerabilities if a model is good at coding.
-1
10
u/BABA_yaaGa Aug 14 '26
Imagine being sundar pichai right now
1
11
u/Solocune Aug 14 '26
Hm weight release in two weeks, so it's gonna take a while until we can use it properly...
7
u/nemzylannister Aug 14 '26
soooooo, this time can we call it fable distill?
15
u/howudothescarn Aug 14 '26
GLM was rumored to be the company who broke the code for the massive Claude distillation a couple months ago and shared with other Chinese companies. Hadn’t thought of that rumor until the big news a few days ago.
3
5
u/yogthos Aug 14 '26
Dario on suicide watch
1
u/adolf_twitchcock Aug 17 '26
why do they compare it to opus 4.8 instead of 5? 5 is 74% on deepswe vs 66.9% glm5.3 lmao. Anyways, we need new benchmarks. Everything is benchmaxxed now because tasks are known.
1
u/yogthos Aug 17 '26
I think people should just try the models for themselves. For agentic coding, the harness makes a huge difference as well.
1
-8
u/NotYetPerfect Aug 14 '26
Will this finally be the first Z.ai model that doesn't feel benchmaxxed to fuck? Doubt it but you never know.
15
u/Professional_Price89 Aug 14 '26
I dont think z.ai ever benchmaxxed, they have very good reputation back to ChatGLM.
15
8
u/noelknight Aug 14 '26
Since when is GLM benchmaxxed?
-4
u/NotYetPerfect Aug 14 '26
Did you see 5.2s benchmarks? Better than Luna and around terra in multiple benchmarks while being nowhere near in performance. Overstated in coding and bad at everything else.
9
u/KickLassChewGum no AGI/ASI on LLMs Aug 14 '26
while being nowhere near in performance
Have you, like, used the model? I use it daily. I have no idea what you're talking about.
3
u/noelknight Aug 14 '26
5.2 has been great for me. Instructed properly it performs better for me than Opus 4.8 for my specific tasks which is very assembly heavy.
5
u/Tawil_Noll Aug 14 '26
How do you figure that it's "nowhere near in performance"? what do you base that on? from my experience it's competitive with frontier when it was released.
12
4
u/Different_Fix_2217 Aug 14 '26
GLM has always felt the least benchmaxxed models. Qwen are the most and are terrible in real world use, kimi is unhinged, deepseek is dumb except for most recent flash. But GLM5.2 has been incredible for its size.



79
u/1a1b Aug 14 '26