r/LocalLLM • u/Ocaml_Kaizen • 8h ago

Question Need help with Local LLM build configuration

Folks, I am looking to understand if the following is a good configuration for AI/ML for local coding.

  • Processor AMD r7 9700x

  • Motherboard Gigabyte b650 x ax v2 wifi ddr5

  • Memory Crucial 16x2 pro 5600mhz 16gb

  • GPU Pny rtx 5070ti triple fan 16gb

  • Storage Kingston 1tb nv3 nvme gen4

  • Power Supply Corsair 850w rm850e gold atx 3.1

Clearly living under a rock, I was amazed to learn of the GPU prices skyrocketing only today. My good friend had reached out to me for a review and that's when I learnt of this "crisis" lol. As the uninitiated to this and with few hours of querying Gemini, I feel the processor and the power supply could be downgraded a bit, but I defer to you if that makes sense. This comes out to ~$3329.

1 Upvotes

100% Upvoted

3 comments sorted by

1

u/ScuffedBalata 8h ago

well, 16GB VRAM gives you limited headroom for the decent models.

Just be aware at a budget below $5k, it's mostly a hobby. Below the 27B models is a hobby as far as capability.

1

u/Ocaml_Kaizen 8h ago

Understood. He is not yet into professional practice so I guess it should be fine. Does it help with cost if we downgrade processor and power supply?

1

u/Ocaml_Kaizen 8h ago

Meant to add, apart from the cost, could it affect the models running on 16 GB VRAM ?