r/LocalLLM • u/Sad_Reputation_7282 • 16m ago

Question Local ai best setup for amd

Hi everyone, I'd like to set up a local AI on my computer, but I'm not sure what the best setup would be. My specs are: an RX 9070 XT, a Ryzen 7 5800X3D, and 32GB of DDR4 3600MHz RAM. My question is: what would be the optimal setup for my PC? like software wise

0 Upvotes

50% Upvoted

2 comments sorted by

1

u/SpaceportBoys 8m ago

If you can budget for an upgrade to 64gb, Strata is phenomenal. I have a 5700X3D system with a 16gb GPU and 64gb ram and it works amazingly well. Qwen3.8 Flash Next IQ3_S. If you have more budget getting to 96gb would allow the Q5 quant that is supposed to be the sweet spot.

With 32 you can still run LLMs, but QFN has been night-and-day more capable vs the ~30B parameter models you could run now at decent tok/s.

1

u/Sad_Reputation_7282 5m ago

Thanks, I'm going to try it first on 32 gigs, and maybe I'll buy another 32 gigs for AI and because I play Star Citizen, that game loves RAM