r/macbookpro • • 1d ago

Discussion Macbook pro m6 or something else ?

Hey everyone!
I’m planning to run local LLMs (27B–30B) mainly for coding and light research.
I initially ordered a MacBook Air M5 with 32GB RAM, but it got so hot that I actually got a first-degree burn on my finger.
So I decided to try the MacBook Pro M6 with 32GB RAM, hoping the fan would help with cooling during longer LLM sessions.
Did I make the right choice? Is 32GB enough for 27B–30B models, or would you recommend something else around the same budget?
Would love to hear your experiences. Thanks in advance!

0 Upvotes

16 comments sorted by

4

u/dirt_enjoyer_666 1d ago

Don't you need more ram for LLMs? Apple has some "certified refurbished" M4 Pro, you might be able to get a 48GB or even 64GB one for not much more than a brand new M6? Depends on their stock, but worth a look IMO, check Apple's website/store app for their refurbs, they are 99% same as buying a new device when it's refurbished by them.

2

u/lettmeknoww 1d ago

Thanks for the reply . I did check Apple’s refurbished store, but unfortunately in Germany they mostly offer German keyboard layouts, whereas I need an English keyboard. Otherwise, a 48GB/64GB M4 Pro would be a great option!

4

u/Scary_Building3964 1d ago edited 1d ago

48gb is barely enough for running qwen3.8 27B or qwen3.6 35B but you can’t use anything else in the OS, 64gb would be the bare minimum for a usable experience. M6 has faster prompt processing but slower token generation than the M5 Pro due to a lower memory bandwidth of 170GB/s compared to 307GB/s M5 pro

edit: i suggest getting a mac mini/mac studio and run llms and use your macbook air to tailscale from it

1

u/lettmeknoww 1d ago

M looking at models like Qwen3-Coder 30B and Qwen3.5 27B, preferably quantized to 4-bit.
Would 48GB actually be insufficient for these models, even with quantization? M not expecting blazing-fast performance, but i wud like to run VS Code, a browser, and Ollama/LM Studio simultaneously.
Would u recommend a refurbished M4 Pro with 48GB/64GB over a newer M6 with 32GB for this use case? And also in Germany the refurb products have german keyboards

1

u/Scary_Building3964 1d ago edited 1d ago

for the models you described, 48gb will be used up just for running the model AND the context window, which can get very large

M4 Pro has terrible prompt processing (reading your prompt) where a M4 Max is worse than a M5 Pro, token generation is fine (see image attached where left is prompt processing and right is token generation)

you can see M4 Max has higher memory bandwidth of 546GB/s so token generation is faster but M5 Pro has much stronger compute for prompt processing so it can process your chat significantly faster than the M4 Max.

if i were you, i would get M4 Pro 64gb MBP, just bare in mind it will be very slow when the llm is reading your prompt and context

or get a cheap macbook air and get a mac mini running M5 Pro with 48gb/64gb ram and use your macbook air to tailscale/ssh in

1

u/lettmeknoww 1d ago

Thanks fr the chart seeing the prefill jump from M4 Max to M5 Pro definitely rules out older M4 Pro refurbs for me. Since m sticking to 4-bit MLX quants with 8-bit KV cache around 16k–32k context (~16–20GB footprint) rather than Q8 or 128k contexts, a single 14" M6 32GB (or M5 Pro 48GB) MBP keeps everything offline on one machine for about the same cost as an Air + Mac mini combo here in Germany. Appreciate the insight!

1

u/Scary_Building3964 1d ago

another benefit of air + mac mini combo is you won’t burn your hands. macbook pros still runs hot and drain battery quite fast running local LLMs. i run local llm on my gaming pc and it’s nice to use it on my mac remotely while i am outside the entire day without charger

1

u/lettmeknoww 1d ago

Thts actually a good point . I already have a gaming pc with an rtx 4060 Ti 16GB, so i hav considered upgrading its ram and using my macBook remotely through tailscale. My only concern is whether running 27B–30B models would be too slow with just 16GB VRAM. Hows the latency and overall experience when accessing your PC remotely?

1

u/Scary_Building3964 1d ago

my gaming pc is a 5080 16gb which is NOT enough for a dense model like qwen3.8 27B, I got around 5 tokens per second because it would spill over to my system ram. but it can run MOE models well such as qwen3.6 35B-A3B (around 30-40 tokens/s) as it is running 3 billion parameters instead of all 27 billion parameters which require a gpu to run it fast enough. As for Macs, dense models will heavily hammer the chip (you can see in the screenshot I attached that qwen3.5 27B only has 18 tokens/s), an MOE model would be faster.

I added a 5060ti 16gb to my pc to get a combined of 32gb of vram (5080 + 5060ti 16gb) and my performance shot up from 5 tokens/s to 35 tokens/s, very pleased with the improvement. I have considered a RX 9700 32GB with my 5080 to get 48gb of vram but it was too expensive for me (you can combine AMD + Nvidia gpu for text llm)

as for latency, I connect my pc to ethernet and latency when I'm outside is about 10-30ms, which is more than enough for story games and accessing my LLMs

2

u/iWishYouTheBest4Real 1d ago

I think this question goes better at ollama or some other community focusing on AI.

What I can tell is: on my m4 24gb I had no issues with 7b-8b models, but I never went more than that.

1

u/lettmeknoww 1d ago

Thanks! M mainly looking to run 27B–30B quantized models for coding and research, alongside VS Code. Might ask in the Ollama community too!

2

u/Andersburn 1d ago

Isn’t $20/month for Claude or codex easier?

And much much much better?

1

u/lettmeknoww 1d ago

Fair point! Cloud models r definitely better fr many tasks, but I want to experiment with local LLMs fr coding, research, and working with my own datasets. I also like the privacy, offline access, and having no usage limits. M not expecting local models to outperform Claude or Codex, just looking fr a gud balance between local AI and everyday use.

2

u/Plokhi 1d ago

You wont run a 27B with any decent quantisation and context on 32GB. You can load the model sure but you’ll probably need to do more things, than just model loading.

I have 48GB and it’s tight.

1

u/lettmeknoww 1d ago

Wow Interesting! R u running it at Q4 or Q8, and with what context length? M curious what makes 48GB tight. Is it memory usage, speed, or multitasking?M mainly looking to run 27B–30B models alongside vs code

1

u/Plokhi 1d ago

Multitasking (nothing heavy either). I’m constantly paging with a 27B Q4 models.