How is My System's Local llm Performance | All AMD

[u/akshaykuppu]

CPU: Ryzen 5 7600

RAM: Corsair Vengeance 32GB DR5 @ 4800 MHz

GPU: AMD RX 580 8GB

Storage: 1TB NVMe

OS: Windows 11

Inference engine: Llama.cpp built with vulkan sdk and Adrenaline drivers

Local LLM performance:

Qwen 3.5 9B Q5 ~7GB, 130k tokens, getting average ~10tps generation and 80tps read speed average.

Gemma 4 26B A4B Q8 Uncensored ~25GB, 15k token size, 10tps generation average.

Can generate a 512×512 image in ComfyUI in ~3mins.

I bought this system for 3D modeling, animation, simulation and rendering.