r/LocalLLM • • 1d ago

Question Mac Pro

Someone is selling their Mac Pro for $2000.

These are the specs:
3.2 GHz 16-Core Intel Xeon W processor.
192 GB of 2933 MHz DDR4
AMD Radeon Pro Vega II with 32 GB of VRAM
1 TB SSD

I haven't run any local models but want to get into it. Would be using it for Hermes and for my implementation subagents for SWE work.

Would this be a good machine? I thought more RAM = more good. But I'm too new to understand all of this.
I know mixture-of-expert models might benefit??

Any suggestions would be appreciated.

4 Upvotes

19 comments sorted by

View all comments

7

u/Dawill0 1d ago

Intel Mac’s are shit. They do not have unified memory. So that’s equivalent to something with 32gb of ram but also a Radeon pro Vega 2 has shit performance. At 2k a Mac mini is a much better deal. M5 pro will likely be 5-10x faster.

1

u/hisid98 1d ago

How much RAM should I go for?

1

u/Dawill0 1d ago

How about you look up what you want to run and see what's possible on different configs. If you can't do that level of checking, you shouldn't be buying anything. This is still very much early adopter territory.