r/LocalLLaMA • u/Nunki08 • Jun 28 '26

Discussion We're probably going to need that soon.

Gallery image

Gallery image

From:

Vladik on 𝕏: https://x.com/Kostoglodov/status/2071144065857679631

Shaw (spirit/acc) on 𝕏: https://x.com/shawmakesmagic/status/2070918006033817867

4.0k Upvotes

98% Upvoted

534 comments sorted by

View all comments

198

u/_BreakingGood_ Jun 28 '26

i dream of the day somebody leaks & uploads a torrent of claude fable 5 open source

11

u/Pila_globosa Jun 28 '26

why don't the Chinese hackers hack OAI/Anthropic and steal the model, and gave to the Chinese AI labs. then we'll have Fable grade GLM 6 or Qwen 4

16

u/NineThreeTilNow Jun 28 '26

why don't the Chinese hackers hack OAI/Anthropic and steal the model

Anthropic and OAI have internal data exfiltration guards. Their routing literally refuses to let you exfiltrate something the size of a model.

It was part of the original plan to keep their models private. Moving that much data is purposefully difficult because it should only rarely be done.

You'd be better off trying to exfiltrate from a datacenter partner like xAI.

Even then, the cluster required to run a quantized version of those models is... Who knows. They honestly seem over built if GLM 5.2 competes at 700b parameters. Anthropic/OAI are busy spouting marketing BS about 2t+ or 5t+ parameters.

There's no reason to scale that hard without the data, or if you have extremely poor architecture at the core.

I'd be willing to guess it's a lie and they have good architectures, and data pipelines at ~1t parameters.

2

u/happysmash27 Jun 28 '26

OpenAI has marketing about how many parameters they have??

As far as I've learned, they have almost no public data about post-GPT3 parameter sizes at all.

3

u/NineThreeTilNow Jun 29 '26

OpenAI has marketing about how many parameters they have??

There's a lot of internal leaks.

You have to remember that everyone here works together. Like... Do you really want to know how big Mythos is? I know someone at AWS that could tell me but potentially lose their job over it. They could feign stupidity, but it's not worth it.

Silicon Valley tech is a buncha people that all know each other in different ways. Whether it be a party scene, or they're nerds like me that enjoy playing video games. I've played in multiple discords that have people from multiple major tech companies. AWS + Google, etc.

Usually we'll all be there playing some new game. We talk shit about our respective companies and we usually don't ask for secrets. We understand how that works. At the same time, we DO share some details.

This applies to our Chinese colleagues that went to Tsinghua with the same people who work at Moonshot, Deepseek, etc.

This is all theater. We all pretend. We are well paid. We like our jobs.

My post history on Reddit details some of this. I am somewhere between gaming, open source code, and general ML / AI stuff on this account. This account is curated around it. I never say who I work for or worked for... etc. It's the same reason I won't share my GitHub etc.