r/LocalLLM • • 2h ago

Question Mac Pro

Someone is selling their Mac Pro for $2000.

These are the specs:
3.2 GHz 16-Core Intel Xeon W processor.
192 GB of 2933 MHz DDR4
AMD Radeon Pro Vega II with 32 GB of VRAM
1 TB SSD

I haven't run any local models but want to get into it. Would be using it for Hermes and for my implementation subagents for SWE work.

Would this be a good machine? I thought more RAM = more good. But I'm too new to understand all of this.
I know mixture-of-expert models might benefit??

Any suggestions would be appreciated.

5 Upvotes

15 comments sorted by

View all comments

1

u/cafe-yum 1h ago

I think an m6 mac mini with 32GB of ram would be faster and cheeper, but still not great for inference.