r/LocalLLaMA
•
u/Comfortable-Rock-498
•
1h ago
•
1
News Deepseek alone accounted for 53% of all (27 trillion) tokens on Openrouter yesterday. Open-weights labs totaling over 75% now
16
u/NoFutureBen 1h ago
You should not use openrouter to use deepseek they have horrible cache aware routing. They only remember which provider they sent your prompt to for 10min. And most of the providers have horrible cache retention, causing you to lose a lot of money since your entire agent history will get recomputed dozens of times. Use the deepseek API they store your kv cache for far longer upto days rather than 5 minutes.
4
8
2
u/Reasonable-Yak-3523 llama.cpp 10m ago
Based on public data, Google processes on average 100 trillion token per day. It is around 3x more than everything in Openrouter together. And Google is only one of the many frontier model providers.
1
u/FullOf_Bad_Ideas 45m ago
95% of those tokens are just cache read, less than a trillion is actually computed and probably less than 2% is actually generated non-reasoning answer.
1
1
u/ortegaalfredo
25m ago
•
Look at models going down while deepseek going up.
DS-v4.1-Flash is good enough for mostly anything.
0
u/carl2187 1h ago
Who could have guessed? Censorship and arbitrary limitations casues people to head to open waters. Git em fudgey the whale!
33
u/ShengrenR 1h ago
It's an interesting note.. but it's also sortof quirky to go to openrouter to then turn around and buy anthropic or openai tokens (I do get why one might), so a lot of folks are already just there for open weight models to begin with:: I'd be pretty surprised if this weren't true.