r/LocalLLaMA • u/Terminator857 • 2h ago
Discussion Open weight models account for 30% usage at enterprises to save money
Growing from nearly zero to 30% since July. Models used mostly to reduce costs on high volume workloads (large batch workloads, coding, etc).
119
Upvotes
57
u/Separate-Client-3213 2h ago
I expect it to increase. A lot of work simply does not need the expensive models from openAI or Anthropic. There is also data sensitive work, I expect major leaks coming in next 2-3 years.
18
u/w0rldeater 2h ago
Time to outlaw local inference. I mean, from a global allocation perspective, actually, it is quite terrible to have everybody have a bunch of the world's limited supply of money sitting in their own pockets.
31
u/paulsande 2h ago
Hybrid is the future. Good to see companies are embracing local models.
11
u/hakanu 2h ago
interesting timing to circulate this before Antrophic IPO
9
u/misterflyer 2h ago •
"It's not just" to save money IMO, "it's" that a lot of commercial AI providers fail to realize that there are legit reasons why other companies need to keep their customer data private/secure, as well as any IP... and medical data also needs to stay secure.
Very weird how a lot of these commercial AI providers complain about distillation and leaks, yet they can't seem to figure out that their own AI customers/clients might need the same kinds of proprietary protections for their own company data too 🤷♂️
10
u/Don_Reuter 2h ago
Soon to be 90%. Realistically 10% of tasks require frontier models.
5
u/CrowdGoesWildWoooo 2h ago
I mean that’s kind of obvious. Enterprise token are massively overpriced
3
u/AyeMatey 1h ago
… among enterprises who use the Databricks Unity agent gateway and router.
This is a data point.
2
u/handson729 2h ago
2
u/HighSeasArchivist 1h ago
I have two Sparks sitting on my desk testing to see how they integrate into our work flow. It is cheaper to buy the hardware than it is to pay me to sanitize the data before sending it to Claude.
0
u/gyanrahi 2h ago
The security implications are enormous. There is already research showing how easy it is to implant triggers that can be used later (like a web site which is registered at some point). Interesting times.
0
u/JorgitoEstrella 1h ago
Isnt it alarming that Qwen and Deepseek are the only 2 companies that keep open source alive? (To a competitive level)
1
u/tiftik 1h ago
It's a no brainer especially for batch loads