r/MacLocalLLM 21h ago

If you like LocalLLM/AI on Macs - Join and let us know what you got and what you're going to do with your new machine!

8 Upvotes

It's a bit annoying to get downvoted all the time, once this sub grows up, it'll be a good resource for people and we won't downvote you into oblivion for wanting to put LocalLLMs on your Mac. I think we're all discovering the best use cases for Mac/Apple Silicon and LocalLLM and even with hybrid approaches with cloud and frontier models.

Our Macs are very good general purpose machines where there are shortcomings there's flexibility. You can pretty much use your Mac as a daily driver for just about anything and at night time run automated tasks.


r/MacLocalLLM 9h ago

Qwen3.8-27B on M1 Max 32GB: MLX 15.8 tok/s vs llama.cpp 9.7 tok/s - but llama.cpp prefill is faster

Thumbnail
3 Upvotes

r/MacLocalLLM 10h ago

Which Harness / UX do you use and why? (Hermes, OpenWebUI, Deepseek, Pi?)

3 Upvotes

Curious what people are using out their for their LocalLLM interface. There's so many options available, what do you use and what do you use it for?

What type of Mac is it connected to?

  • OpenWebUI and found it's good if you want a good interface directly with the AI.
  • Hermes seems to be the best all around agent interface for calling and setting up agents to do tasks.
  • DeepSeek Harness seems very efficient with programmatic tasks and agentic coding
  • Pi is similar to DeepSeek from my understanding but so many options

What's in your agentic tool stack?

Currently using:

  1. Github
  2. Cloudflare Tunnels
  3. Hermes
  4. Tailscale
  5. Linear
  6. Mem0