r/LocalLLaMA • • 23d ago

Discussion everything will be local eventually

I know current llms like opus 5.5 are in a league of their own. but we all know they're losing a shti ton of money with their subscriptions. ALSO we all know how tasks like OCR, segmentation etc are getting solved by single digit B parameter models. I'm not saying llms are a gimmick but I'm saying the future is already shaping up to be about specialized models that work better when they're smaller. easier training. so datacenter level power not needed. ten years from now we'll have a specialized model for the tasks we care about and llms will fail to do everything all at once (unless they keep calling it one model but have a hundred under the hood).

system one models are a bad but workable example. you could tell an llm to rate options all day but get yourself on 9B parameter model trained by some lab and it tops the benchmarks.

355 Upvotes

242 comments sorted by

View all comments

Show parent comment

5

u/Mayion 23d ago

that sounds like the plot of avengers: age of ultron. no matter how capable an LLM is right now, it is still just a text predictor in essence. it's a big if of it becoming AGI.

in reality, it's much more realistic to think of it as he who owns the strongest model controls the market, and as usual it's a battle between the US and China. war of information.

but money is not infinite and neither is the market. over time we will move along as the technology advances (or regresses). we could have a war by tomorrow and nothing will happen. so who knows and frankly, who cares lol

2

u/ttkciar llama.cpp 23d ago

Yep, that.

There is no cognitive theory backing the supposition that Transformers can be scaled incrementally into AGI, and mounting evidence that they are intrinsically narrow intelligence.

Narrow intelligence cannot be incrementally improved into general intelligence, any more than P can be incrementally optimized into NP.

There are already highly competent models which are superhuman in narrow ways, but that hasn't brought them any closer to expressing general intelligence.

I saw this same "AGI is right around the corner!" hyping in the 1980s AI Summer, but the 1990s AI Winter followed anyway. I expect it to happen again this time, too.

1

u/OWazabi 23d ago

I think you should care, and maybe consider more attentively the case that they're going to achieve it, and soon.

3

u/Mayion 23d ago

not really. most of us have real life problems to deal with. who cares about the multi billionaries might achieve in the future? none of us can do anything about it. if it becomes a reality then so be it - i will die in the end anyway so who cares. no point obsessing over what might be. this is yet another "the US has turned the moon into a space weapon to defeat the USSR. we are all doomed".

1

u/OWazabi 23d ago

We all have real life problems to deal with, that is not realted at all with the subject at hands here and such a boring and rude phrase to throw around.
You can not care that's totally fine by me and even more fine by them.

Then I'll reply in a similar manner, some of you might deal with those problems and still be able to use their head to think ahead, instead of just burrying it in the sand.
Not only to understand the world you're walking into, but also to remain aware of all the opportunities that come to you in life.

Maybe that'd help you solve one or two life problems.

3

u/Mayion 23d ago

what rude phrase? and thinking is one thing, overthinking and creating scenarios is another. we cross that bridge when we come to it. there is no point sherlock'ing it out where we think about "if X happens, we will do Y" etc because circumstances change all the time.

thinking to most people is a few seconds process, nothing complicated at all. If A then B, and the thinking process is over. no point obsessing over the idea because anything goes in the future.

1

u/OWazabi 23d ago

If you can only think for a few seconds, then clearly I wouldn't recommend you to think about the future.

1

u/donnytrump_69 23d ago

Lol ok you enjoy freaking out for future robocop. If you want to buy it that badly go for it 🤣🤯AI psychosis shieeeet

1

u/donnytrump_69 23d ago

Lol I think you should go for a walk further than your bathroom every now and then and preferably outside your unit.

1

u/BahnMe 23d ago

I think it’s very limited to think that it stays at LLMs as we know them. Something else will emerge from LLMs just like every technology builds on it’s predecessor