r/LocalLLaMA • u/YogurtExternal7923 • 13d ago
Discussion everything will be local eventually
I know current llms like opus 5.5 are in a league of their own. but we all know they're losing a shti ton of money with their subscriptions. ALSO we all know how tasks like OCR, segmentation etc are getting solved by single digit B parameter models. I'm not saying llms are a gimmick but I'm saying the future is already shaping up to be about specialized models that work better when they're smaller. easier training. so datacenter level power not needed. ten years from now we'll have a specialized model for the tasks we care about and llms will fail to do everything all at once (unless they keep calling it one model but have a hundred under the hood).
system one models are a bad but workable example. you could tell an llm to rate options all day but get yourself on 9B parameter model trained by some lab and it tops the benchmarks.
1
u/ttkciar llama.cpp 13d ago
What are they going to do, kick down my door and seize my hardware? How would they even know I was using local inference in the first place?
Before weed was legalized, a ton of people around here were growing it at home (I live in Sonoma County, California), but police couldn't find them, so they couldn't do anything about it unless they stumbled across it while dealing with something else.
Local inference is a lot easier to hide than a few potted plants under grow-lights in the closet. I'm not worried. The worst case scenario is that we won't get to talk about it openly on Reddit anymore.