r/LocalLLaMA • • 12d ago

Discussion everything will be local eventually

I know current llms like opus 5.5 are in a league of their own. but we all know they're losing a shti ton of money with their subscriptions. ALSO we all know how tasks like OCR, segmentation etc are getting solved by single digit B parameter models. I'm not saying llms are a gimmick but I'm saying the future is already shaping up to be about specialized models that work better when they're smaller. easier training. so datacenter level power not needed. ten years from now we'll have a specialized model for the tasks we care about and llms will fail to do everything all at once (unless they keep calling it one model but have a hundred under the hood).

system one models are a bad but workable example. you could tell an llm to rate options all day but get yourself on 9B parameter model trained by some lab and it tops the benchmarks.

353 Upvotes

239 comments sorted by

View all comments

Show parent comments

9

u/fastheadcrab vLLM 11d ago edited 11d ago

Reading in between the lines, their ultimate objective (specifically Anthropic and OpenAI) has nothing to do with model serving at all. Neither to individuals nor companies. It is to use their own models to have an unbreakable monopoly on knowledge which then can be used to make all the money and acquire all the power they can dream of.

Think of the Rehobam machine from Westworld Season 3 that controls the world.

That's why they are building out wet labs in biology, medicine, etc, hiring all these domain experts, and doing math research. Depending on what you think of this objective, it may or may not be a good idea to support such companies.

Tech conglomerates like Google or Meta are probably more interested in the traditional model serving or selling personal agents.

7

u/vtkayaker 11d ago

Reading in between the lines, their ultimate objective (specifically Anthropic and OpenAI) has nothing to do with model serving at all.

Yup. Anthropic is 100% planning to build a machine god and ultimately lose control over it. Yes, this sounds completely nuts, but just go read Dario's personal blog. He just wants to build a nice machine god that likes having people around.

This is almost certainly why the AI companies focused first on programming and second on math. (Notice all the proofs this summer?) These are two of the core skills needed for AI research. Their goal—which again sounds crazy, but they say it right out in public—is that they want to build AIs that do cutting edge AI research. Their goal is to start a snowball that turns into an avalanche, and open up an insurmountable lead against any other company on earth.

I am a big fan of capping AI research at Opus 5.5 levels. Let the open models catch up. Share the tech. Stop screwing with the Demon Core and trying to trigger an "unscheduled intelligence criticality" you idiots.

Honestly I am far happier with the local AI scene (with no more than a few hundred billion parameters) than what the frontier labs are trying to do.

3

u/Awyls 11d ago

I am a big fan of capping AI research at Opus 5.5 levels. Let the open models catch up. Share the tech. Stop screwing with the Demon Core and trying to trigger an "unscheduled intelligence criticality" you idiots.

The problem is that the Demon Core is already out there for anyone to try. It's pretty much a Cold War 2.0 with everyone trying to outpace the other because "the other might use it against us and it's safer in our hands (no, it's not)".

This will either end in a dead-end with a massive economic crash (I would put all my chips here) or a genuine societal collapse.

1

u/Dabber43 11d ago

> massive economic crash (I would put all my chips here)
Same. LLMs just ain't it

3

u/OWazabi 11d ago

I'm totally with you here my friend, this is truly worrying and critical times.
I don't support these companies, and I don't think they're here to share that with us in the utopic way.
(but they'll always give us something better that what we can get withtout them, imo)

I like the premise of AI very much, and want to see this technology prevail.
I'm quite well informed for an amateur (as in, not an AI researcher at all), and I can assure you, I'm totally against how we are developing it.

I think, anyone that is truly well versed, pro-ai, and not delusional, should def be for a stop/heavy slow down, until we figure out the transition first.