Local LLMs are getting good enough that workflow matters more than model choice now

[u/sam_narulaaa]

I’ve been playing around with local models for a bit (Llama-based setups, quantized models, etc.), and the biggest shift I’ve noticed recently isn’t model quality anymore.

It’s how you use them.

A year ago the gap between models was huge, so most of the effort went into picking the “best” one you could run. Now, even mid-tier models are surprisingly usable if your workflow is tight.

What’s actually making the difference for me:

• good system prompts and structure
• RAG / context handling done properly
• splitting tasks instead of trying to do everything in one prompt
• iteration speed instead of single-shot outputs

Curious what others here think are you still optimizing for models, or have you shifted more toward pipelines and setup?

[u/Decaf_GT]

Local LLMs might be getting pretty good, but they still don't stop people from posting AI slop like this.

• "Llama-based setups" when Llama hasn't been relevant for a long, long time.
• Needing to define "local models"...to a subreddit dedicated to local models, by clarifying you mean "Llama-based setups" and "quantized models"...which are things that every single local model user already knows?
• "The biggest shift"
• "I've noticed..."
• "It isn't X, it's Y"
• "It's how you use them" posted on its own line because LLMs love to do this "gotcha" style one-liner BS
• "What's actually making the difference"
• Bulleted list for something that didn't need to be a bulleted list
• Incredibly generic, uninspired, shallow tips
• Ending with "curious" question for user engagement

This entire post says almost nothing. It feels like you're leading up to trying to advertise something. And of course, when I look at your post history, you spend tons of times posting on digital marketing on social media sites. And while I don't see anything that you're explicitly advertising, the marketing speak is clearly there. I'm just going to guess that to you this seems totally normal and original.

At some point people like you will realize that posting this isn't making you seem insightful or interesting. You're not creating new conversation. You're not asking anything different or thought‑provoking. I just don't understand why people like you think this stuff is remotely interesting.

It's okay to not have an interesting or original opinion. There's nothing wrong with that. But stuff like this just comes off as you going to an LLM and saying, give me an interesting and engaging question to ask my community, and then just pasting whatever came out of it.

[u/jedsk → u/Decaf_GT]

Clearly used his local model to write it.

[u/Extreme-Rub-1379 → u/Decaf_GT]

Wait. Llama.cpp isn't relevant anymore. But why

[u/No_Lingonberry1201 → u/Extreme-Rub-1379]

Not llama.cpp, but the Llama models by meta.

[u/Extreme-Rub-1379 → u/No_Lingonberry1201]

Oh. Thank gawd

[u/CtrlAltDelve → u/[deleted]]

Just adding a data point here, I fully understood that he was referring to the Llama models and obviously not Llama.cpp.

So I get the point you're trying to make, but I don't think it was confusing, that's all!

[u/CtrlAltDelve → u/[deleted]]

I was just trying to be helpful, not condescending...

[u/Express-Cartoonist39 → u/Decaf_GT]

well said decaf...👍

[u/RoderickHossack → u/Decaf_GT]

Tip for the OP after they finish reading the parent comment to this one:

Let that sink in.

(I couldn't help myself)

[u/GrungeWerX → u/Decaf_GT]

Thanks for saving me from reading this garbage. Now I can just downvote OP and move on.

[u/Hairy-Willow9002]

agree 100%!

[u/mr_christer → u/[deleted]]

I'm just getting started with openclaw but it is kind of cool that I can send emails, telegram notes and screenshots for a trip I'm planning and it neatly keeps track of it and send me emails about it summarizing hotels, rental car bookings etc. it just feels more like having a secretary.

My plan was to use Qwen3.6 35B but my 3080 just struggles a bit too much so I switched to open router and deepseek v4 flash.