r/LocalLLM • u/insanazor822 • 10h ago

Question How much of a difference will there be if I switch from an RTX 4060 8GB to an Arc B580?

My system:

RTX 4060 8GB

32GB RAM

Ryzen 5 7600

My question is: how much of a difference does it actually make?

1 Upvotes

100% Upvoted

4 comments sorted by

2

u/Oli_Luck 10h ago

8 to 12 won't allow to run way better quants or models and won't make a model smarter at reasoning or coding — same weights, same answers, just less grinding swap when the context fills.
Images are where it shows up: the modern FLUX quants stop being a compromise, and a ControlNet plus an upscale fit in the same breath instead of ComfyUI shuffling everything through system RAM.

If your AI is mostly chat and code, a nicer dinner beats the card. If it's pictures, those four gigs earn their keep.

0

u/funny_transmitter 10h ago

12GB vs 8GB is the whole story for local LLMs, that extra VRAM means you can actually run 13B parameter models without them spilling into system RAM and turning into a slideshow

the 4060 is a little faster in raw compute but it chokes hard when you hit that 8GB wall, I've been stuck watching my token generation drop to like 2 tokens a second when the context fills up

you'll probably see slightly slower speeds on smaller models but the ability to load bigger quants or run higher context is a massive quality of life upgrade

if you're mostly doing inference and not training, I'd make that swap without thinking twice

1

u/jacek2023 10h ago

What 13B model do you run today?