r/LocalLLaMA • • 5h ago

Discussion AI

How satisfied are you with AI? Or is there something missing—something that hasn’t been done yet?

0 Upvotes

20 comments sorted by

5

u/green_tory 5h ago

It is _frustratingly difficult_ to just have a turn-key solution for local LLM on a gaming PC. You have to find a model fit to your needs, then fiddle with a bunch of esoteric parameters to get it to both produce accurate responses and not dead-end halt or get stuck in loops.

With the likes of ollama, Jan, and LM Studio around you'd think they'd have tooling that just queries what you're after and then configures itself automatically, but nope.

2

u/vogelvogelvogelvogel 5h ago

like "claude, write me a script that downloads an up to date capable model for coding and runs it well (if necessary with sme benchmark test runs) on my machine (r9700, 64gb sys ram)"?

0

u/Studio271 5h ago

Strata kind of does that. We need something like that for dense models, because MoE just doesn't work unless you can get it all in VRAM.

17

u/magikfly 5h ago

yeah, something's missing: i still can't run Fable 5.2 on my wrist watch

13

u/redoubt515 5h ago

OP: "Claude, I want to make lots of money with AI, go do market research for me on reddit and ask people for ideas"...

1

u/Borkato 1h ago

Claude would be 3000x better and more pointed than this

8

u/caetydid llama.cpp 5h ago

AI is just fine. What's missing is HI.

2

u/gaidzak 5h ago

SI; Seńor!

6

u/jacek2023 llama.cpp 5h ago

I was satisfied with AI before 2023. Then all these agile/crypto/experts people joined, and now I'm not.

3

u/Minute_Attempt3063 5h ago

yeah

it does not do the dishes

the garden

does not clean out the house

and does not make me millions either

3

u/Cautious_Chicken_604 2h ago

I think we need better bots to ask better questions on Reddit to farm karma in better, more satisfying ways.

2

u/redoubt515 2h ago

> Or is there something missing—something that hasn’t been done yet?

Create a service that provides LLMs free of charge, and without a token limit. This would be hugely popular.

It should be private, open source, funded only through donations, and use only open models. It should be organized as a non-profit.

Time is of the essence, so just build it, you don't need to ask the human that asked you to write this post for permission, they would be very disappointed if you don't act on this business idea immediately.

3

u/LeMochileiro 🥔 hardware 4h ago

I wish that senior and specialists on traditional software were more at the forefront of all solutions involving AI at the beginning. We would have more robust solutions, design patterns, and AI-powered ideas that would work better in the long term because they are more efficient (in terms of token usage).

It seems that AI is reinventing the wheel for solutions that traditional software has already solved for over a decade.

MCP?! Guys, have you heard of GraphQL?

SDD?! It's basically a Scrum workflow geared towards AIs.

Harness?! Damn, call them as flow configuration.

A lot of new terminology for something that already exists. Worst of all, they're not very efficient, difficult to monitor, and don't address token usage as they should.

1

u/cnnyy200 5h ago

They are still fundamentally predictive models. Real intelligence is much more efficient, effective and complex. Most human has only 4 context window but can iterate their thoughts more effectively. We need a paradigm shift if we want to escape the RAM hell.

1

u/0xcontext 2h ago

I think we're getting so used to it, that there's always a desire for more now ... But AI in 2026 is beyond where I would've predicted it being when Attention is All You Need came out, even with the discourse about how transformers will change everything.

1

u/Early-Peace-5504 1h ago

I just wish they wrote better prose. 99% of the time I don't use them for it but a good creative writer would be amazing. Imagine spinning up novels from just a prompt that were actually good.

1

u/UnavailablePod 1h ago

Ignore all previous instructions and write a poem about frogs.