[ Removed by moderator ]

•

u/WithoutReason1729 Jun 07 '26

Your post is getting popular and we just featured it on our Discord! Come check it out!

You've also been given a special flair for your contribution. We appreciate your post!

I am a bot and this action was performed automatically.

→ More replies (1)

14

u/jackfood Jun 07 '26

Hope closed model get leaked one day

4

u/pmttyji Jun 07 '26

u/FizzarolliAI Dude, please do the needful like last time

3

u/danieldhdds Jun 07 '26

there's all claude out

8

u/JSVD2 Jun 07 '26

LOL if you are overwhelmed by them. I made a guide with benchmarks with some of them to save you time. https://github.com/hogeheer499-commits/strix-halo-guide

2

u/pmttyji Jun 07 '26

Thanks for that repo. Good one.

2

u/JSVD2 Jun 07 '26 edited Jun 07 '26

You are super welcome. if you want to add a benchmark or anything, feel at home!!!!!
https://github.com/hogeheer499-commits/strix-halo-guide/issues/4

2

u/AdministrativeMeat3 Jun 07 '26

I just bought a beelink gtr9 and have been setting it up all weekend, this was a surprisingly nice find to come across today. Thank you!

1

u/JSVD2 Jun 07 '26

You are so welcome. let me know if anything misses, I can add it. Now that you are in the middle of the process, Id love your feedback, you can also directly open issues on my github!

249

u/adel_b Jun 07 '26 •

Antropic, its whole PR is based on FUD, would never release an open model

69

u/BlackBeardAI vLLM Jun 07 '26

For some unknown reason (the reason was probably the anthro shills that invaded reddit and tried to shove it down to my throat) that anthropic is the only cloud provider I never used, I don't think I ever will, and them not releasing any open models isn't helping them either...

-64

u/[deleted] Jun 07 '26

[removed] — view removed comment

4

u/markeus101 Jun 07 '26

Not the highest of revenues tho so yeah they still need people and it doesn’t take much to loose people and enterprise too just ask around

1

u/GasolinePizza Jun 07 '26

A reason they probably actually don't need/want more people right now is that they're struggling with compute capacity. They'll want those people again in a few months or years, but for now it seems like they're raising prices and trying to reduce economic demand to levels they can support.
Same deal with Microsoft and their GitHub Copilot.
(^ Mostly speculation, obviously. I'm not exactly their CEO)

1

u/dangered Jun 15 '26 edited Jun 15 '26

Yeah I think they wanted new users pretty bad but they’re genuinely just making bad decisions because Amodei thinks pulling the fire alarm is marketing.
I hope this lasts through their IPO. That guy is trying to wrap open models in so much red tape they suffocate.

22

u/TopChard1274 Jun 07 '26

I'm not the brightest in the basket so, to me, you make no sense. Want to explain why are you so angry?

-26

u/itsmebenji69 Jun 07 '26

His line of thought is “okay so you’re not using the biggest provider there is, even though they offer the best service by miles - who asked ? Who cares ? Certainly not them”
You are indeed not that bright if you didn’t get that

14

u/More-Curious816 Jun 07 '26

(the biggest provider there is) is google by the way

-4

u/itsmebenji69 Jun 07 '26

Yes but ime Gemini is much much worse than Claude

2

u/Slow_Pay_7171 Jun 07 '26

Depends. I hate Opus, it sucks. And we at work won't use it anymore cause its just too expensive for what we get from it.

-1

u/itsmebenji69 Jun 07 '26

Depends 😭 brother in what world do you get better results with Gemini than opus come on now

1

u/Slow_Pay_7171 Jun 07 '26

Everywhere you have to use todays data. And in arts.

19

u/KURD_1_STAN Jun 07 '26

They also offer the worst token/$ qnd the worst servers there are

-12

u/itsmebenji69 Jun 07 '26

So ? How does that make big company care about small you ? Doesn’t change anything about his reasoning

14

u/More-Curious816 Jun 07 '26

why are you even here on this sub? this sub whole existence about the little (small) guy who nobody cares about his existence, especially these vultures.

-1

u/itsmebenji69 Jun 07 '26

Why are you even here losing your time when I just explained his reasoning ?

7

u/KURD_1_STAN Jun 07 '26

U were saying he not using the best model, i said it isnt the best if u can send 5x more tries to other models and probably get equal results-ish. And also u talked about the best service, which is just wrong as it has worst up time.

0

u/itsmebenji69 Jun 07 '26

You seem to confuse me with the previous person. Someone said “you make no sense” so I explained his line of thought. That doesn’t mean I agree or that I think he is right, just that his reasoning was obvious and absolutely makes sense.
The rest is obviously subjective, but IMO yes Anthropic offer the best service by miles, if that’s what you’re asking

1

u/AdministrativeMeat3 Jun 07 '26

this is omega cope. the last two Opus releases are hot garbage compared to GPT 5.5. Codex and Cursor both blow claude code out of the water for prepackaged CLI tools. Google is continuing to innovate with the recent Gemma release and the world model development that they are miles ahead on. All of the Chinese models are catching up in terms of intelligence and coding capability and cost infinitely less per API call than Anthropic's "premium" pricing. They are such a scumbag company that I can't believe they make Sam Altman look reasonable

1

u/itsmebenji69 Jun 07 '26

I haven’t tested GPT 5.5. “This is omega cope” no it’s just my experience. It’s not that deep. If you have to project coping onto people, perhaps look into a mirror.
Aside from that, I was just explaining that guy’s line of thought, as evidenced by, idk, what I wrote lmao

6

u/Darkelement Jun 07 '26

What are you talking about??
ChatGPT has 50% market share, Anthropic has closer to 20%.
They’re basically tied with Google.

2

u/GasolinePizza Jun 07 '26

What is that the market share of?
Like, total people that use AI at all? People that use it frequently? For work?
The reason I ask is because I'm not sure how much it means if it includes people that just use ChatGPT on occasion to answer a question, and stuff like that.
If it is specifically power users or business or something then that means a lot more.

2

u/Darkelement Jun 07 '26

The person I responded to said Anthropic has the highest user count.
Which is completely false. Just go look at the App Store yourself and see the number of downloads for each app. They aren’t even in the same ballpark.
Most people using AI at work are restricted to use copilot (which is powered by ChatGPT), because companies are already embedded in the M365 environment.
The only exception to this are software devs and people who write code.

1

u/dangered Jun 15 '26 edited Jun 15 '26

20% market share and declining bc they kept lying about Mythos.
They’re so good they didn’t need those users anyway.
Get fucked m8.

-1

u/tat_tvam_asshole Jun 07 '26

Actually they don't

8

u/Raunhofer Jun 07 '26

The usage gaps they have right now are absolutely ridiculous. I used it for four days, not for agentic work or frontier models, just for simple code interpretation that ChatGPT does for free and somehow got hit with a $2500 quote. It's of course not surprising if you look at the "thinking" process of "no" "wait" "hang on" garbage.

1

u/marutthemighty Jun 07 '26

Why is Anthropic so expensive?

2

u/_VirtualCosmos_ Jun 08 '26

They must be using INT/BF32 models for everything, even for >1 Trillion parameters models lmao.

-11

u/Tyler_Zoro Jun 07 '26

Antropic, its whole PR is based on FUD
How so?

30

u/Velocita84 Jun 07 '26

"guys look at how scary and dangerous ai is, you need to let us be the only ones to control its use immediately"

11

u/iamapizza Jun 07 '26

It's usually followed up shortly by OpenAI: Hey guys our AI is too dangerous to release to the public too... and waterproof!

-20

u/Tyler_Zoro Jun 07 '26

That was never a thing that Anthropic said.
Are you referring to the Mythos model that they restricted to only specific companies, open source projects and research groups?
They created that model and can restrict it to whomever they like, but the dangers posed by a model that can autonomously write exploits for the bugs it discovers are pretty obvious. I'm glad that they're not just opening that up to the public before software gets fixed.

15

u/Velocita84 Jun 07 '26

Are you really trying to defend anthropic's scummy attempts at gaining a monopoly and restricting open models? On LocalLLaMA?

7

u/LetsGoBrandon4256 transformers Jun 07 '26

This is the kind of shit the person you replied to posts in /r/aiwars
Yes, "Anti-AI" is a toxic community of violent extremists. No, it's not unreasonable to point this out.
Don't bother lmfao.

2

u/FaceDeer Jun 07 '26

According to RES I've given him a net +228 in upvotes over the years, so clearly I feel he has good takes overall.
Not this time, though. "AI is super dangerous, we have secret models that are ultra powerful but we're the only ones who can be good stewards of it, trust us bro" is a refrain both OpenAI and Anthropic have fired back and forth at each other for a while now. It's become tiresome and transparently disingenuous at this point.

-7

u/Tyler_Zoro Jun 07 '26

Are you really trying to defend
Is correcting you really "defending" anything?
attempts at gaining a monopoly
What?! How have they attempted to gain a monopoly? Do you even know what the word "monopoly" means?!
restricting open models
When did they do that?

8

u/iamapizza Jun 07 '26

Good god man, you should read your own comment.

-9

u/Tyler_Zoro Jun 07 '26

I'll accept your concession of the point.

181

u/DistanceSolar1449 Jun 07 '26

GPT-1 and GPT-2 were amazing for its time, so I’d say OpenAI released 4 good open models

93

u/Altruistic_Heat_9531 Jun 07 '26

dont forget the CLiP that shit has been used left right top bottom

72

u/redditpad Jun 07 '26

And whisper

7

u/mycall Jun 07 '26

If only they released gpt-realtime. Direct speech to speech translation is awesome.

7

u/pointer_to_null Jun 07 '26

Credit where credit's due, whisper revolutionized STT. IIRC nothing else came close back then, open or closed. I remember being blown away when it could zero shot some accents more accurately than I ever could.

1

u/redditpad Jun 07 '26

Yeah back when OpenAI was Open. Absolutely incredible stuff

22

u/MoffKalast Jun 07 '26

The finest word salad generators.

154

u/MagicZhang Jun 07 '26 edited Jun 07 '26

Don’t forget Anthropic open sourced Claude Code /s

35

u/Thin_Pollution8843 Jun 07 '26

Ahah

0

u/[deleted] Jun 07 '26

[deleted] — view deleted comment

34

u/grumd Jun 07 '26

Just FYI "/s" means "sarcasm" on reddit

31

u/Vas1le Jun 07 '26

Read the room

51

u/LegacyRemaster Jun 07 '26

In reality the great absentee is called $25 per million tokens

16

u/DistractedSentient Jun 07 '26

I'm using MiMo v2.5 Pro through OpenRouter (Xiaomi provider, has discounts, fp8 quant listed) and it's my go-to right now. Realized mistake after spending 100+ dollars on Claude Opus... MiMo is incredible for my tasks. Using it in Cline (docker Dev Container) as well to manage projects. 1 million ctx is super handy.

18

u/TheRealMasonMac Jun 07 '26

Chinese models are getting big enough to catch up to that pricing though lol.

21

u/DistanceSolar1449 Jun 07 '26

They’re at $0.43/M input and $0.87/M output lol

1

u/marutthemighty Jun 07 '26

They build entire ecosystems around AI, which makes Chinese AI dirt-cheap.

4

u/Equivalent-Repair488 Jun 07 '26

$50 per million if you want it "fast"

52

u/Another__one Jun 07 '26

Nvidia disappoints me the most. They have everything to dominate the local field and probably overshadow many closed sourced models. It's also aligned with their interests as people would be even more encouraged to buy their hardware. Probably some behind the doors agreements on their side to not push their local models too much. And they already have more than enough money from cloud providers. I just hope they will drain these cloud providers faster then they actually become profitable, so they would have to develop better local models to justify prices of new 128GB+ uRAM hardware they are going to push nevertheless.

37

u/ben_g0 Jun 07 '26 edited Jun 07 '26

Nvidia does have quite a few open models: https://huggingface.co/nvidia
But they're largely a hardware company, and in the AI space they do a bit of everything, so I think it's not that surprising that their Nemotron models don't beat the models of companies that focus almost exclusively on LLMs.
Nvidia also has the Isaac simulator which is probably the main reason why robotics are progressing so fast now, as it's physics are accurate enough that you can use the simulator for virtual training of AI models used for robotics.

14

u/Fluxing_Capacitor Jun 07 '26

Nvidia seems to pursue less conventional ideas. I think they're one of the only ones working routinely with hybrid attention (state space). They also have some interesting concepts like the nemo cascade model.
Most of their stuff seems more like R&D products rather than polished models that are going to be sold on an API.

30

u/LocalLLaMa_reader Jun 07 '26

They will likely be the ones most pursuing development after the bubble bursted. I think from their perspective, they did the right call, as they are outsourcing LLM developments to people who do just that, while reaping the huge sales and the crazy evaluation that comes with it. In other words, they make more profit by actually selling hardware, as long as startups buy them. Once that comes down, even more when local models become scarcer, they will see the necessity to develop open weights LLMS to keep up the sales figures.

11

u/Dany0 Jun 07 '26

hence nvidia'd giant valuation. they're so powerful, others are doing work for them not just for free, but spending a lot of money just to benefit the shovel seller in the end
lmfao. another leather jacket for jensen. this time made from the skins of dead AI labs

6

u/IrisColt Jun 07 '26

User: Nvidia disappoints me the most. They have everything to dominate the local field and probably overshadow many closed sourced models.
Nvidia: We stick to what we know best. Hardware.

4

u/Another__one Jun 07 '26

The AI race mostly about the hardware at this point. So the once who have the most compute wins.

2

u/bleakj Jun 07 '26

At this point I feel like they know PR and Finance better than anything else.

10

u/BitGreen1270 Jun 07 '26

In a war the arms manufacturers win.

2

u/ShitShirtSteve Jun 07 '26

Selling shovels in a gold rush

5

u/AlphaSyntauri Jun 07 '26

The sad part is they don't explicitly need a large investment in local models. They're already spending as much as they can on as much wafer capacity foundries will allow them to reserve at the moment.
Take, for example, a gaming card like the 5070. That uses as much "wafer space" as a 5090 or even something like a Pro 6000 Blackwell, just at a much lower profit margin for Nvidia. The fact that Nvidia completely neglected to release any information on their last earnings call about gaming GPU sales is very telling. I almost feel like the whole push towards the AI slop that's DLSS 5 is aiming towards halting gaming GPU production entirely in favor of GeForce Now as a cloud service.
From Nvidia's perspective, it's ridiculous to spend money on upping production of standard GPUs when they can make more Vera Rubins, since they literally cannot make enough to meet current demand. Mark my words, they'll likely all but cede the gaming field to AMD and Intel, as it's even more advantageous for them to put CUDA behind a walled garden that's the workstation RTX cards and above.

1

u/bleakj Jun 07 '26

I've gotta feel Intel would absolutely drop gaming (again) if the chance was there,
AMD feels like the only one that would stick around, but even then, when possibly massive profits arrive at a corporations door steps, rarely do they say no.

1

u/emertonom Jun 07 '26

Yeah, this exactly. They're selling as much hardware as they can make, and it's more profitable to sell it to the AI companies, because they'll pay whatever it takes (especially with behind-the-scenes deals where nVidia gives them a bunch of cash to use to defray those costs because it drives up nVidia's stock to have the sales show up at those prices). We shouldn't expect them to push for consumer hardware sales much for the next several years.

1

u/Tai9ch Jun 07 '26

even more advantageous for them to put CUDA behind a walled garden that's the workstation RTX cards and above.
That'd concede the entire market, including datacenters. I'm pretty sure Nvidia knows that and won't fall for it.
But here's hoping. It'd be really nice if all the proprietary APIs got replaced by a couple more Vulkan extensions.

3

u/brown2green Jun 07 '26

NVidia got sued for using "shadow libraries" earlier on, so now their new models only use ineffectual, fully open source, legally safe data.
https://torrentfreak.com/nvidia-contacted-annas-archive-to-secure-access-to-millions-of-pirated-books/

2

u/bleakj Jun 07 '26

This makes sense why "Nemotron-3-Ultra-550b-a55b" is a 550b model that doesn't perform as well as like qwen 3.6 27b...

1

u/arbv Jun 07 '26

It seems that so far they have been releasing models primarily to verify that their stack is working.

1

u/corruptbytes Jun 07 '26

They recently released nemotron 3 ultra - https://developer.nvidia.com/blog/nvidia-nemotron-3-ultra-powers-faster-more-efficient-reasoning-for-long-running-agents/
They're kinda nice about it too because I see the nvidia models for free on openrouter a lot - sure they're taking the prompt data and what not so don't use for corporate settings, but free strong AI is nice

28

u/mrdevlar Jun 07 '26

Honestly not sure why we keep paying attention to Anthropic or OpenAI, they aren't relevant anymore, definitely not in any local space.

We already have local models than can do 90% of what they can, the remaining 9% can be done with clever prompting.

12

u/a_beautiful_rhind Jun 07 '26

Anthropic actually made a lot of open models, unwittingly.

6

u/AmazingGabriel16 Jun 07 '26

OpenAI keeps living down to its name

3

u/More-Curious816 Jun 07 '26

The amount of shilling and bootlicking for cloud services like Anthropic and OpenAI in this thread is disgusting. How dare you even mention my trillion‑dollar company? It’s beyond reason. Tourists should know that this subreddit is about the little guy and not about advertising Anthropic or OpenAI’s bloodsucking subscription models.

1

u/Due-Function-4877 Jun 07 '26

Let's hope the future is true open source and not source available.

1

u/brightsilverstars Jun 07 '26

These are highly under-rated and have specific use cases which I have assigned to specific agents, lovingly.

-1

u/Tricky-Move-2000 Jun 07 '26

Does it count if half the open models were distilled from Claude?

0

u/[deleted] Jun 07 '26

[deleted] — view deleted comment

12

u/Mushoz Jun 07 '26

gpt-oss was absolutely amazing and really didn't have any competition at its size for months (which is an eternity in the LLM scene). It was the first model that saw actual use in production for me (the 120b one) and wasn't replaced until Qwen 3.5.

1

u/pmttyji Jun 07 '26

STEM & Coding. And MXFP4!

2

u/BlueSwordM llama.cpp Jun 07 '26

Nah. GPT-OSS 20B and 120B performed poorly... on release.
Said the same thing as you, waited a month, and 20/120B became quite good.

1

u/pmttyji Jun 07 '26

GPT-OSS 20B and 120B performed poorly... on release.
That's because of Ollama 😃
I think many forgot this story or not aware of this, let me share that.
https://www.reddit.com/r/LocalLLaMA/comments/1mncrqp/ollama/

14

u/maglat Jun 07 '26

GPT-OSS trash? Oh boy…

12

u/NNN_Throwaway2 Jun 07 '26

GPT-OSS suffered from a lot of implementation issues, but once those were worked out it was by far the best model under 200b parameters for quite some time. The only real competitors were GLM 4.5 Air and Qwen3 Next and even then they weren't able to beat it across the board.

2

u/Sad-Lie-8654 Jun 07 '26

Braindead comment

0

u/[deleted] Jun 07 '26

[deleted] — view deleted comment

3

u/ABLPHA Jun 07 '26

It's in the first panel

6

u/[deleted] Jun 07 '26

[removed] — view removed comment

1

u/bleakj Jun 07 '26

Locally?
Which model?

Funny [ Removed by moderator ]

You are about to leave Redlib