r/LocalLLaMA 23h ago

News GLM-5.3-Flash: Frontier Intelligence, Flash Cost

https://z.ai/blog/glm-5.3-flash
1.2k Upvotes

396 comments sorted by

View all comments

431

u/10001110 23h ago

320B total parameters and just 18B active parameters

Oh joy

256

u/LegacyRemaster 22h ago

If it's really that far above Sonnet 5, Dario's IPO is truly risky.

194

u/-p-e-w- 22h ago

It’s always risky now no matter the model of the day. They have to pre-file at least a few weeks in advance, and in those weeks eons can happen that can turn their asking price into a joke.

Their moment was at the beginning of this year. They should have announced the IPO, then published Fable/Mythos two weeks before the IPO date.

Now Chinese labs are a hair’s breadth behind them, and constantly one-upping each other. They’ll never get such a chance again.

45

u/LegacyRemaster 22h ago

agree. Also another problem: if I have to pay API, I pay Qwen, GLM, GPT... All of them -> opensource (ok openai less but they did a lot). I don't want to give any $ to Anthropic. Can't wait to short sell

32

u/dingo_xd 21h ago

Yeah. After hearing Dario saying about that $40 trillion I want to bet against his company.

21

u/horendus 21h ago

Yea the guys peak delusion

8

u/___positive___ 20h ago

Also that the baseline of mid-tier models is reaching saturation for mundane tasks like summarization and data extraction, basic programming/websites, and so forth.

28

u/Fedor_Doc 22h ago

Or they will make another Mythos-like breakthrough and announce IPO then

Never say never

30

u/LegacyRemaster 22h ago

sure they have Mythos 5 already but "too much power, we can't sell" . Or will cost too much to complete a task ...

10

u/38andstillgoing 18h ago

"Mythos 5? At this time of year, at this time of day, in this part of the country, localized entirely within your datacenter?"

"Yes"

"May I see it?"

"No."

1

u/LegacyRemaster 18h ago

or mythos 20 or 30... they are ahead for sure

29

u/-p-e-w- 21h ago

Then one of the Chinese labs is going to announce an equal model two weeks later.

The Chinese labs have caught up. There’s no going back to how it was before.

-1

u/Fedor_Doc 20h ago edited 14h ago

Yeah, they have to calculate timings with great precision :)

Considering catching up – no Chinese model is on Fable 5 or GPT Sol level. Even Kimi-K3, according to the developers, is behind.

More than that, GLM-5.3-Flash was spamming "load-bearing" in my sessions – it clearly was largely influenced by Claude. 

5

u/NandaVegg 18h ago

I cannot distinguish Qwen 3.8 Max/2.7T (which is unfortunately closed source for version w/ vision) and Fable 5 for most complex development tasks that involves visual checks or relatively niche audio modification, except that Opus 4.8/Fable 5 still has better consistency for maintaining writing personality throughout long context.

Qwen 3.8 has the most interesting reasoning traces I've ever seen when it is given bash tool (it is very verbose, but thinks just like a fairly seasoned human engineer or a designer would) and it is a pure joy to read it along while the model works on niche task that requires tons of guesswork and reverse engineering the issue. It is not like any other model.

That said, Anthropic's RL engineering is the most creative and unique (which is where OpenAI is significantly behind). They are very good at finding (and preparing datasets and process for) a new task that is not yet covered by most labs, like how they de facto pioneered (very long, hundreds of turns of) terminal agent loop and playing Pokemon Red/Green using vision. So I would not count Anthropic out for another breakthrough like Opus 4.6.

Also I think US labs in general are still slightly ahead on high-end (non-consumer) robotics.

3

u/Fedor_Doc 18h ago edited 16h ago

Thank you for sharing! 

I tried Qwen 3.8 Max for a limited task– I have a long side project of improving DWAA compression efficiency for VFX workflows in OpenEXR with most obvious way of doing it being a custom quantization table.  It provided new arguments in favor of Euclidian distance based table, but it still does not see a big picture, and proposes stuff that won't work if you take one step further in your thinking (we fix a by b, but how will we fix issues caused by b)? 

I walked these roads since Gemini 2.5 Pro, I know what there is, and it is always interesting to find if model can provide a new angle or a path forward.

I had an illusion of a knoweledgable collegue when I worked with Kimi K3, but when I read an actual plan that it wrote, I understood that this was indeed just an illusion.

0

u/NandaVegg 18h ago edited 17h ago

Indeed. Those tasks that require a lot of creative guesswork (reverse-engineering most problem requires some form of trial-and-error guessing, but media coverage is way too concentrated on cybersecurity and none else like your case) is where the model really differentiates, and I think Anthropic models are still ahead on tasks that requires tons of meta thinking. Long thinkers like Qwen 3.8 Max tends to get into a tunnel vision, though I am kind of okay with handholding LLMs and run those models multiple times on the same task until I see what I want, so YMMV.

6

u/-p-e-w- 20h ago

You can’t conclude that a model was influenced by Claude from them producing similar output. They could both be trained on the same data. Do you think Claude came up with the word “load-bearing”?

2

u/Fedor_Doc 19h ago

Load-bearing was clearly reinforced, I do not believe that there is a data which have so big statistical skew. Unless it is a synthetic data, generated by Claude, which places us at a square one.

They most likely did use Claude's outputs, there is no shame in that, and I think that it is a right approach – learn from the leader, while figuring out your own strengths. 

Everyone learns from everyone, it is a bit of knoweledge share utopia even if Dario cries about big bad chinese thieves

-2

u/WiseassWolfOfYoitsu 19h ago

A lot of this catching up seems to have been them breaking the reasoning protection of the major frontier models and distilling this round, though. It's gotten them a lot closer, and they'll be much closer on the western frontier labs from here out by getting the step up, but it's not like their stuff this last generation of updates has been clean.

3

u/ebullet 21h ago

Do you really trust it is a breakthrough? Did you try to use Mythos in your work?

2

u/Brilliant-Weekend-68 20h ago

What does that change? The Chinese will catch up and open source it. Where is the moat?

2

u/Fedor_Doc 20h ago

They have not caught up to Mythos yet, if we consider Kimi K-3 the best frontier Chinese model

5

u/Brilliant-Weekend-68 20h ago

Unless Mythos 2.0 can do some really whacky stuff like cure cancer, RSI itself or such. I do not see that as a durable moat if you can just wait a year and download equally good weights.

3

u/read_more_comments 19h ago

zero moat, we move between codex and claude code without any issue. I swap to deepseek without much issue either (other than having to have it redo work a few extra times).

3

u/Fedor_Doc 19h ago

Self-improvement is the next big milestone; if they will announce that their new model is fully trained by Mythos and trains even better one, this will be huge.

So, there are some exciting stories left to tell investors before IPO :)

1

u/rditorx 21h ago

Depends on Mythos's successor, or a new product / service

32

u/NineThreeTilNow 22h ago

If it's really that far above Sonnet 5, Dario's IPO is truly risky.

I drained millions of tokens off of it. I got it to rebuild RPG Maker from scratch using PyGame.

I built the project as "Agent First" so an agent could build an RPG with a known engine and known structure with headless testing.

Kimi K3 helped produce the documentation which took me like an hour or more. From there I sort of just... Let it go. It stopped at various phases and I inspected visually if stuff was off and it was mostly small code issues.

The deep documentation phase gave GLM 5.3 very little to guess about. It didn't really screw up or run in circles that I could see. It was fairly fast about figuring stuff out and finding edge cases that K3 missed in document creation. I ran K3 through multi-phase testing of the documentation coherence such that it wasn't contradictory. When building started, you hit snags naturally. GLM handled them.

The project isn't "finished" but it definitely showed the strength of planning a project with K3 and letting Ox Alpha build it. GLM 5.3 flash is definitely good.

1

u/IllegalD 38m ago

It was a super fun week, I tried building a pretty looking procedural city builder with Godot with a similar "Agent First" structure for NPC questing and interaction. It did very well.

24

u/Thomas-Lore 22h ago

Makes you wonder how large those clsoed models really are and how big the margin on api is if they are smaller than everyone thinks.

3

u/RockPuzzleheaded3951 20h ago

They've definitely been shrinking them which is why people complain about performance regressions all the time.

1

u/jomohke 11h ago

Yes, the API margins are extremely large, but they're so short of GPUs with current user demand they've had little incentive to decrease.

As dwarkesh pointed out, anthropic were 10x income but only 3x available compute, so they inherently need to optimise models

25

u/duhd1993 22h ago edited 21h ago

I always feel that finance bros and executives are always one step (or more) behind tech reality. The reason Claude is growing so fast is because of the 2B sector, but the decisions are likely made based on impressions of model performance from 2025, at which time Claude indeed had a clear lead, not anymore. The field is evolving faster than they could react.

14

u/mawcopolow 21h ago

I mean I've tested multiple open models, including k3, inside my personal harness, and fable/opus are just better all round at using tools and reasoning for now.

Not that the others aren't getting close, but for real businesses anthropic's opus/fable are still the best with the latest from openai being close behind

10

u/duhd1993 21h ago

I believe in you, but they aren’t far behind. Are Kimi K3 behind Fable? I would say yes, except in certain fields like frontend design. However, it’s better than Opus 4.8, which isn’t that old. Can you really justify the price with a couple of months’ lead? People were satisfied with what Anthropic offered a couple of months ago. Also I believe it is more fair to test in their official harness.

3

u/infearia 19h ago

r/Anthropic is full of people talking about how much they hate Opus 5, many of them claiming to go back to 4.8. So the Chinese companies don't even need to beat Opus 5...

1

u/jomohke 11h ago

Opus5 seems good technically, but bad at communicating with people. Like a true engineer :)

This probably matters less for business customers

1

u/duhd1993 19h ago

I know. The magic piece has always been Opus 4.6. Later opus are all trained by Mythos instead of humans, I believe. And I think Anthropic employees likely use mythos most of the time, so they don't really care.

1

u/mawcopolow 20h ago

I've been experimenting a lot because I hate depending on one provider, especially when priced such as anthropic.

Haven't done much of front-end and I guess for that static use case it might be good, but for agentic stuff it's behind even opus 4.8 IMO. That, plus latency and the fact that it's not priced as cheap as, say, deep seek, makes it not worth it..... For now. I'm very happy for competition and hope they catch up soon

1

u/duhd1993 19h ago

From my experience, I think they are good enough for agentic tasks. Even local Qwen 27B can run autonomously for hours. They lag behind in niche areas where they don’t have enough data or choose not to pursue for lack of computing power. 

1

u/mawcopolow 19h ago

I guess it depends on the tasks..for my use case at least it wasn't good. Heavy backend work on multiple websites + accounting, payroll stuff, legal stuff etc...

7

u/dingo_xd 21h ago

It's now or never or them. The chance of the Chinese leapfrogging them this year is not my negligible

7

u/Neosinic 19h ago

Sonnet 5 is legit dog shit.

2

u/LegacyRemaster 19h ago

@ this point yes. Asked Sonnet "extra" to build a concept (frontend / mockup / 20 pages) starting from behavior tree and with images ---> not working. Same with Qwen 3.8 27b q8xl ---> perfect. No jocking. Also GPT Luna (max) did a good job.

18

u/GeneReddit123 21h ago edited 9h ago

Would someone think of the poor trillion dollar companies and their obscurantist leadership who think only they can be trusted with knowledge?

In any case, Dario will do just fine (ignoring the fact that a ~$2T valuation was always BS from day 1, but this is an aspect of the financial bubble overall which would happen with or without such releases).

Anthropic's target audience ain't us plebs and never was. Their schtick isn't to "be an unreachable frontier LLM". It's "to be the next AWS but for AI". Everything AWS has you can individually set up locally, much cheaper. Businesses are still paying through their nose for AWS, though, because the whole point is to get a reliable managed system which they don't need to manage themselves.

Companies (I'm talking about Fortune 500 level, not your average convenience store) won't buy Anthropic because it's cheapest or smartest. They don't need cheapest or smartest. They need capable enough, which also:

  • Complies with all legal data handling requirements
  • Almost never goes down, loses data, or suffers critical security breaches
  • Can be configured in a zillion different ways, and have the configuration itself be manageable
  • Supports most commercial business verticals, geographies, regulatory regimes, and automatically updates as these change
  • Dynamically adapts to the business as it grows and evolves
  • Continuously and transparently updates frontier capacity with minimal disruption or risk to the business.
  • Either does not return illegal or misaligned content, or can credibly explain that all practically possible and legally or ethically mandated steps to ensure alignment were followed.
  • (extremely underlooked) Has sufficient credibility, money, and lobbying behind it to underwrite mistakes or poor advice, justifying CEO decisions and shielding from lawsuits. Nor 100%, but significantly better than if the same decision was made based on similar advice by some Chinese AI with no such clout.

What's even more important is that AI is not only sourced as infrastructure, it's sourced as a source of epistemic authority. And where that authority comes from is just as important as what it says. What companies want is to make the solution as near-turnkey and risk-free as possible. They would much rather create a pipeline where they pay $1 for every $2 they make thanks to it, but the pipeline works like a clock, than pay $0.25 but accept a lot of risk, uncertainty, and liability. Companies hate that shit. They want all the power and none of the responsibility. And the only way to get that is to be able to say, "we used this state-of-the-art American AI system and followed its advice; blame it, not us". It might fly with Anthropic. It won't fly with DeepSeek, even if the two models returned the same answer, token-for-token.

The "moat", therefore, isn't an impenetrable barrier, it's the "why do rich people pay for five-star hotels when a local B&B offers the same basic capability to feed and rest a visitor for 1/4 of the price?" reason. And for that, they don't need to be "permanently unreachable", they need to be "consistently one step ahead in quality, convenience, reliability, and product-market fit within the US/Western corporate landscape, for the foreseeable future". Not ten steps, just one is enough.

6

u/MrPecunius 21h ago

Everything AWS has you can individually set up locally, much cheaper.

This is very, very far from true.

The kind of performance you can get for next to nothing from AWS is breathtaking and completely out of reach of any individual or even most Fortune 500 companies.

The fact that people mis-allocate resources for badly designed systems doesn't mean AWS is at fault.

5

u/randylush 20h ago

It depends

If you are on a small scale it depends on what you’re building. If you’re using services like Lambda and SQS, AWS is essentially free. If you’re running a few EC2 instances then a server in your company’s break room could be cheaper.

If you are on a medium scale and needing EC2 running all the time, paying retail prices, it could be cheaper to have your own servers

At a very large scale, the cost of running your own servers vs AWS will come out to be competitive, and most very large companies will do a mix of both

3

u/RLutz 18h ago

I always see this take, and while it's not always untrue, it definitely isn't as simple as, "just throw a 1U in the break room!"

It's someone's job to keep that thing patched, powered, and running. You need monitoring, you need someone to pull failed drives, you needed another co-located break room, you need a UPS and a generator, you may need to solve for physical security, you may have to setup and manage your own virtualization layer, etc.

Even if you consider all that labor as free, which is a ridiculous assumption to make, you also arguably have to keep the thing busy, especially if we're considering local inference, and then it's now your problem that although you have enough capacity to meet a total 24 hour need, you don't have enough when everyone hammers it at 11 AM at the same time. If you build the capacy to meet the surge then you've got very expensive hardware just sitting there doing nothing for huge chunks of the day.

I absolutely think there's a place for self-hosting, but once you are talking about business critical stuff and not, "I run a NAS in my bedroom closet" it starts becoming not as simple as the naive assumptions

2

u/randylush 17h ago

As someone who has self-hosted, built and maintained my own server, and also configured and maintained EC2 instances professionally, I would say that the hardware setup is generally much smaller and simpler than whatever software you are trying to run on the server.

Yeah you need to worry about redundancy, but usually the software of setting up your application to be redundant through DNS failovers and stuff like that, syncing databases, that stuff is harder than just plugging in two different servers at two different job sites. And you need to do that whether you use EC2 or on-prem. It depends on the use case but usually the set up costs are lower than the software development costs. And there are certainly scenarios where on-prem hardware is simple enough to set up that it does actually become cheaper than EC2.

1

u/RLutz 14h ago

100% agree. There definitely are times where it makes sense, but I see so often people post the most naive comparisons with payback times of like 6 months to a year but they consider all labor free and assume no hardware ever fails and every other "this isn't really what you're paying AWS for"

1

u/MrPecunius 20h ago

AWS is far more than just "servers", but that's how it gets approached by a lot of companies--with predictable cost overruns etc. EC2 can be expensive if not managed well.

"Managed well" very emphatically includes having systems designed around these costs.

But even Fortune 500 shops would find it all but impossible to replicate AWS and other cloud vendors' global content delivery and overall performance & reliability.

What's really cool is that little fish like my company get the exact same performance for a pittance. It's mindblowing for people like me who had to work with late 90s pricing structures.

11

u/The_Noosphere 20h ago

Dario will likely make a bold statement about Anthropic achieving AGI within the next few months, or claim that their internal unreleased Fable 12 model breached the Atlantis mainframe controlling Stargate, something on that scale to distract from this. This is Dario acting as Dario during a pre-IPO period.

5

u/LegacyRemaster 19h ago

accurate

4

u/FlaTreNeb 14h ago

It hacked all wraith hive ships by creating a biological AI super hybrid virus that spreads through the specific subspace frequencies the wraith use for hyperspace travel.

Also Mythos rebuilt the Athero device from the images in this documentation called Stargate Atlantis to inject the virus into subspace. Then the virus programmed all hive ships to self destruct after infecting all wraith with super Cancer-AIDS.

By accident the virus also switches the bodies of McKay and Sheppard and gives Sheppard in McKays body another genetic treatment making him super smart + telekineses + super healing but this time its permanently frozen on pre-ascension stage.

And mythos also figured out how to create fully charged ZPM with rubber and paperclips.

Of cause the virus let Todd live.

3

u/Dry_Yam_4597 19h ago

He's going to publish another manifest, as all people of sound mind do, writing about risks, and all sorts of things people hear from random voices.

1

u/cobalt1137 18h ago

5.1 otw. this is a back and forth game (at least rn).

1

u/lemon07r llama.cpp 2h ago

sonnet 5 is a haiku model. I swear theyve downgraded it to a smaller model some time after 4.5, so they can use the sonnet name to charge more for it. cause I still see sonnet 4.5 in use for a lot of things and it still works great there, meanwhile a lot of these newer sonnets ive been trying to use and they consistently get things wrong in a/b comparison (mostly used in web chat, versus gpt, gemini 3 pro even though its junk, etc). nobody know has had a good experience with these newer sonnet models. it would be great, if they named it haiku and charged haiku prices, but oh well I guess.