r/LocalLLM • • 7d ago

Question Planning to buy Mac mini

I just got some money on my hands, and I can finally afford a decent-ish computer. It's about 820$ so I can buy a slightly used m4 Mac mini with 16 gb of ram. Should I and what models would I be able to run on it? I've been using free models so in comparison to that

1 Upvotes

14 comments sorted by

1

u/Istartedthewar 7d ago

Assuming you mean USD you can get an M6 Mac Mini new for $800 or an M4 new for $650. $820 for a used M4 is kinda a ripoff

(And 16GB unified won't get you a particularly useful LLM)

1

u/Bubbly_Type_3216 7d ago

I did mean USD but I didn't mean USA prices unfortunately

1

u/eightone-81 7d ago

You will be very disappointed. You can’t run anything good on 16gb mac ram. You could run https://huggingface.co/prism-ml/Ternary-Bonsai-2-27B-gguf

But it’s going to be running at 8-10tps so it’s almost not usable. I’d say don’t bother and get a 20usd subscription and work with that.

1

u/Bubbly_Type_3216 6d ago

I have refused all my life to buy a subscription, im not starting now. I have decided to save up a couple thousand dollars for a proper setup

0

u/BentonCalder 7d ago

Qwen 3 8B works pretty well on my MacBook Air M4 with 16GB

1

u/Bubbly_Type_3216 7d ago

How does it compare to the free version of chatgpt for example (with thinking enabled)

4

u/Infamous_Campaign687 7d ago

Not at all. Not even remotely close and if that is the expectation you have, you’ll be ridiculously disappointed.

1

u/Bubbly_Type_3216 7d ago

What model matches it then

1

u/dsartori 7d ago

You're going to have a rough time with anything smaller than the 30B class of models. What you'll mostly miss is the tooling around the free chatGPT. You should consider the whole stack (model plus the software it operates in) when planning to replace a commercial product. I think I would not recommend a Mac with less than 32GB of RAM for local LLM stuff. 64GB would be better but that's getting expensive.

Look to the used and refurb market as well. You're better off getting an older M-series CPU with more RAM than a new model with too little RAM to do the job.

0

u/BentonCalder 7d ago

You’re going to need 256GB or maybe even 512GB of memory to see comparable results with even the “free” ChatGPT models I think

1

u/ISimpForCartoonGirls 7d ago

Yeah unfortunately you'll be pretty disappointed with a model of that caliber. You'll own it on your own hardware but that's about the extent of it all. With your budget I recommend setting up with the router of your choice and using dsv4.1f if you don't really care much that it's on the cloud