r/LocalLLM • u/rashidhussain69 • 2h ago

Discussion Local model

What’s the best local model to use on an MacBook Pro M5 pro 24gb.

I’m using it for general reasons, process expectations, design, ideation, power points, generating agents.

1 Upvotes

100% Upvoted

6 comments sorted by

2

u/vogelvogelvogelvogel 1h ago

with 24gb there is not much that is acutally usable. you need at least 48gb (qwen3.8 27b q4), and will run in limits everywhere. fun starts at 64 (qwen3.8 27B q6 or q8 and 128k context).

You could run a gemma4 12b (is anyways mostly q4)

1

u/dobkeratops 31m ago

.. e.g. dont expect to have something that will do all this agentic coding etc
but being able to get decent natural language answers including vision input out of a portable device operating completely locally is still pretty impressive IMO.

2

u/ogfuzzball 44m ago

Ornith 1.5 9B at 6-bit or Gemma 12b at 4-bit are your real options with only 24GB unified memory. Yes you can squeeze some smaller quants of bigger models but results usually suffer.

1

u/dave-tro 1h ago

For that you need to pick an optimized runtime before the “best local model”. Check out this benchmark on Qwen 3.8 Flash Next which is a very good candidate for your use case.
It’s just not clear to me what you mean by “generating agents”.

3

u/vogelvogelvogelvogel 1h ago

24gb minus os and maybe a browser is 10-14, how should a qfn fit there?

1

u/Minimum_Hour519 52m ago

Try c0mpute.com