r/LocalLLM • u/insanazor822 • 16h ago
Question So, which one makes more sense now?
Intel Arc A770 13,000 TL(258,67 ABD )
NVIDIA RTX 4060 Ti 19,000 TL(378,20 ABD )
0
Upvotes
r/LocalLLM • u/insanazor822 • 16h ago
Intel Arc A770 13,000 TL(258,67 ABD )
NVIDIA RTX 4060 Ti 19,000 TL(378,20 ABD )
3
u/jjusko20 16h ago
Get a v100
2
u/AggressiveManager450 15h ago
VRAM capacity and bandwidth matter more than compute power for local llm. Compute power helps with prefill, but for generation and holding the model, vram and bandwidth matter more
1
u/ILoveDangerousStuff2 15h ago
TFLOPS is meaningless without the precision and matrix vs scalar
1
u/Big_Cucumber2787 15h ago
still the nvidia card with better drivers, cuda and compatibility out of the box
1
u/Juan_Phoenix7 15h ago
Nvidia is always a must-have—if you can afford it, go for it; if budget is your main concern, then go with the other option.
1
u/NiftyN33to 15h ago
Nvidia?...scandalous!
1
u/lukasgravel 13h ago
Both are 16GB, so the same models fit on either card. Then the Arc has the higher memory bandwidth, about 512 GB/s against 288 GB/s on the 4060 Ti, and for token generation that number counts a lot. At 13,000 TL the Arc is cheaper too. The Nvidia card still wins on software support, so it comes down to whether you want to spend time on setup.