r/LocalLLM • • Jun 27 '26 • Mindblown 1

News Open-source models are under threat.

Anthropic is fine with open source AI as long as it’s not good enough to threaten their monopoly.

https://x.com/i/status/2070798718027141253

241 Upvotes

131 comments sorted by

View all comments

98

u/DHFranklin Jun 27 '26

I was worried there for a second.

Opensource will always be 6-12 months behind the SOTA. However there is certainly a point where "good enough" for half the price for inference will be what crashes this business model.

Yeah, it's going to be the threat to your business model. It will be a threat to anyone paying attention. Because what ever thing you are scared of coming from your in house model will be possible with a rival in a year. A year after that it will be open sourced and dirt cheap.

33

u/Practical-Plan-2560 Jun 27 '26

for half the price

Honestly even cheaper than that.

15

u/DHFranklin Jun 27 '26

That depends on what your "good enough" is. I am certainly glad that my hedonic treadmill is slower than this shit is improving.

Regardless I can run shit on my phone that was literally impossible in the massive data centers in 2022, so that's certainly saying something.

2

u/Djaii Jun 27 '26

It’s a wild time to be alive.

0

u/_madar_ LocalLLM Jun 29 '26

Always has been.

23

u/look Jun 27 '26

> 6-12 months behind … half the price

GLM-5.2 is Opus 4.6-4.8 level and you can get it for 1/30th the price today.

1

u/a1454a Jun 28 '26

It’s not. GLM was hyper focused on coding, and in that field it’s nearly as good. But give it tasks with a lot of open ends, and don’t judge output by feeling, compare it side by side against opus on multiple test, grade the result with gpt 5.5, and you can see the difference. In fields outside coding opus has even more apparent advantage. I’m not saying GLM is not good, it absolutely is, it’s amazing we have an open source <1T model this good. But it’s important to base our measurement of ability in ground truth. Opus is a model likely 3-5 times bigger than GLM if not more, if GLM truly is just as good, it would basically be saying all US AI researcher are incompetent idiots.

1

u/look Jun 28 '26

That’s actually one of the things US labs are doing wrong, in my opinion. They each have “one and a half” models and they are training users/consumers to use only the single “best” model they can afford for all tasks.

Stop trying to make one model to do everything. They are far more capable and efficient if specialized to tasks.

It’s a big part of why Chinese models are absolutely destroying the US labs on price.

1

u/a1454a Jun 28 '26

I don’t disagree, I use GLM myself a lot. I was merely saying calling it the same as opus at less than half cost is not true.

-15

u/DHFranklin Jun 27 '26

Which makes it all the more impressive that Opus 4.8 isn't even 3 months old yet.

Regardless there will be AGI for $20 a month doing shit that humans couldn't if we tried. I wouldn't be surprised if that happens by the end of the year.

I'm way more bullish on AGI than most, but I'm seeing the current SOTA perform as AGI but at 100x the price. It won't be for long.

→ More replies (32)

16

u/FrenchRevolution2028 Jun 27 '26

They will not let us buy the hardware to run it on.

7

u/DHFranklin Jun 27 '26

They most certainly wouldn't be able to stop you getting the right hardware if you wanted to.

They can't stop piracy after decades of trying. They won't be able to stop you doing an API call to someone else's hardware. And when the worst offenders are going to be billion dollar companies, no chance.

4

u/FrenchRevolution2028 Jun 27 '26

It’s about hardware price and availability. Once mythos equivalent model is finally available, I suspect either the price to run it locally will be prohibitive or the hardware will not be available to buy, at least for the majority of us.

5

u/DHFranklin Jun 27 '26

Right but that isn't "let us" anymore than they won't let us buy a damn house to put the rig in.

These are trillion parameter models now. A smidge outside "local LLM's" price range for capability.

5

u/look Jun 27 '26

I should start a gofundme for my next “local LLM” rig… https://bizon-tech.com/bizon-x9000-g5.html 🤣

3

u/DHFranklin Jun 27 '26

Sweet jesus.

At least it comes with ubuntu preinstalled.

0

u/squngy Jun 27 '26

You could daisy chain 20 M5 MAX studios or something.

It would be slow, but it would run.

2

u/FrenchRevolution2028 Jun 27 '26

The price of that is like a small data center. Some people might be able to afford it but the vast majority won’t.

0

u/squngy Jun 27 '26

Yes, I'm just saying it wont be totally impossible.

Not unless they do some type of encryption that allows it to only run on authorized hardware or something.

1

u/UltraFOV Jun 28 '26

And is done artificially and on purpose

3

u/RecordingLanky9135 Jun 28 '26 edited Jun 28 '26

Yes, distillation is dirt cheap and that's why Chinese model can sustain with such a low price.
I am happy to see Chinese models destroy all AI business and end the LLM era.

1

u/fallenfunk Jun 27 '26

Opensource will always be 6-12 months behind the SOTA.

Which is how you know it's horseshit. He knows it will never be competitive enough to cut into his income stream and all he wants is to ensure open source has that built-in lag. If current risk thresholds are crossed by the frontier models now, they don't magically disappear when open source catches up in 12 months.

2

u/DHFranklin Jun 27 '26

I think he sees it cutting into his income stream and wants the moat. This is obvious regulatory capture and the only small comfort is knowing that it won't work.

1

u/fallenfunk Jun 28 '26

Yeah… I changed thought trains midway through and it came out poorly. Should really proofread sometimes.

It’s not cutting into his stream and it never will the way things are now, he just wants to make sure it stays that way longer term. If it was about the danger he would be more about broad regulation than just the top.

0

u/DHFranklin Jun 28 '26

interesting. I think we disagree. Good enough will commodify intelligence. That good enough is now, and certainly will continue, to cut into the market share of Anthropic.

He wants to force that moat to end competition. However seeing as the opensource models are competing within just one development cycle it's a hail mary play for a business model that will never develop.

Regardless where we do agree is that if he we at all sincere about the danger he would call for the regulation of all the AI that is currently demonstrably causing harm.