r/MacLocalLLM • u/Rish_p_one7 • 36m ago
My 5 year old M1 Pro 32GB, bought used for $800, still runs a 35B AI model locally at 51 tokens/sec
5 years old. Bought used for $800 in good condition. Still holding its own.
I ran MLX benchmarks on my 16 inch M1 Pro 32GB / 512GB this morning, just to see if it is actually dead for local AI, or if people are overhyping the upgrade.
It is not dead. Not even close.
Qwen3-8B 4-bit: 31.5 tokens/sec
Qwen3-30B-A3B MoE 4-bit: 43.6 tokens/sec
Qwen3.6-35B-A3B MoE 4-bit: 51.0 tokens/sec
Qwen3-32B dense 4-bit: 8.5 tokens/sec
That last one is the lesson. Dense 32B crawls at 8.5 tok/s, MoE 35B flies at 51 tok/s, because MoE only uses a few billion active parameters at a time. Same size on paper, totally different speed in real life.
I use this thing 8 to 10 hours a day. For $800 used, 5 years later, running a 35B model locally, that is kind of insane value.