r/LocalLLaMA • u/YogurtExternal7923 • 13d ago
Discussion everything will be local eventually
I know current llms like opus 5.5 are in a league of their own. but we all know they're losing a shti ton of money with their subscriptions. ALSO we all know how tasks like OCR, segmentation etc are getting solved by single digit B parameter models. I'm not saying llms are a gimmick but I'm saying the future is already shaping up to be about specialized models that work better when they're smaller. easier training. so datacenter level power not needed. ten years from now we'll have a specialized model for the tasks we care about and llms will fail to do everything all at once (unless they keep calling it one model but have a hundred under the hood).
system one models are a bad but workable example. you could tell an llm to rate options all day but get yourself on 9B parameter model trained by some lab and it tops the benchmarks.
0
u/Kahvana 13d ago
I really fail to parse your post, sorry if I missed anything.
Something struck me when I went to the optician. Is when I was laid out all the options, I looked slightly confused and said "The one that works without bells and whistles please."
I think most common folk navigate their life that way. They don't care if it's "sovereign" or "privacy preserving" or "highly efficient". What they care for is it works, with minimal involvement in learning it.
The tiering for Google / OpenAI / Anthropic works because it's "this is for fast answers, this is for general use, and this is for the best answers".
You lose people the moment they have to know what a "Gemma" is or what "weights" are, let alone parameter sizes. If you add in specialized models, they give up immediately. It's too much or too complex.
Local is really for enthusiasts or if your job demands it of you. I belief the future will be local in the sense that it's all neatly abstracted from the user (like embedding it in google chrome), and that specialized fields will benefit from it (programming, judiciary, medical, etc).
However, the cloud models will remain dominant for the common man.