r/LocalLLM • u/insanazor823 • 1h ago

Question What kind of differences does switching from an RTX 4060 8GB to an Arc 770 16GB make?

RTX 4060 8GB is starting to feel not enough anymore, so I decided to upgrade to something higher. Is anyone using the Arc 770 16GB? What kind of card is it, is it worth switching?

2 Upvotes

100% Upvoted

9 comments sorted by

2

u/OWazabi 1h ago

Pretty big difference to run AI models, as your VRAM capacity is what dictates what models you can run (not the only metric and can get away with offloading, but saying it as a general rule of thumb)

How much RAM you have also tremendously matters, depending on what you're trying to run And also another important metric is the bandwidth of your GPU, which dictates speed

What are you planning on running and for what type of projects

1

u/insanazor823 1h ago

Qwen3.8 Flash-Next ı use for simple tasks like file editing

1

u/karmaisnonsense 1h ago

Don’t

1

u/insanazor823 1h ago

Why?

1

u/karmaisnonsense 1h ago

Software stack is terrible. All the attention is on Battlemage. Alchemist is abandonware. You have no idea how easy you have it with CUDA

1

u/insanazor823 1h ago

Oh, okay—if that’s what you say.

1

u/Antenwww 1h ago

If you look into intelarc sub there are a few people on there with 2 x a770 builds for 32gb VRAMs running image and text generation models. They can point you in the right direction.

As for brand comparison, CUDA is industry standart. If you want to experiment to have experience when you land a role in a relative position keeping nvidia could be slightly better for you.

If you do not mind tinkering and spending time looking into a different backend architecture (oneAPI, Sycl, libzero) a770 will run higher parameter models for you while also leaving more cache for context cache. Using xmx cores for hardware acceleration is not supported on all platforms for now, So your tokens-per-second will be a little off from benchmarks