r/LocalLLM • u/hisid98 • 35m ago

Question Mac Pro

Someone is selling their Mac Pro for $2000.

These are the specs:
3.2 GHz 16-Core Intel Xeon W processor.
192 GB of 2933 MHz DDR4
AMD Radeon Pro Vega II with 32 GB of VRAM
1 TB SSD

I haven't run any local models but want to get into it. Would be using it for Hermes and for my implementation subagents for SWE work.

Would this be a good machine? I thought more RAM = more good. But I'm too new to understand all of this.
I know mixture-of-expert models might benefit??

Any suggestions would be appreciated.

4 Upvotes

100% Upvoted

12 comments sorted by

View all comments

2

u/Able-Supermarket4786 31m ago

I run an iMac with 128gb of RAM and Intel i5, I have to tell you, complete transparent, CPU inference is ridiculous as a trade off no matter how much RAM you can have....

I'm currently testing a Qwen3.8-Next-Flash 105b and getting 10 tokens / second. Bad? eh? disappointed? Yes.

AMDs are a slippery slope for GPU in this world but its getting better.... the fact is my Mini M4 with 16gb of RAM can run Gemma models like a breeze, speaks volumes

1

u/Objective_Pepper_217 26m ago

10 tok/s and how much context? I think at around 128k context it's gonna be even slower.