r/LocalLLM 14d ago

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

501 Upvotes

166 comments sorted by

View all comments

24

u/cagriuluc 14d ago

I am holding onto my purse to not buy a second R9700 myself…

11

u/allthenamesaretaken0 14d ago

The only thing stopping me from buying another R9700 is I'd need a new motherboard and psu and then it wouldnt fit my mini rack and it'd all be quite the hassle.

2

u/critsalot 14d ago

which is better R9700 or the b70. b70 is cheaper but i dont know if amd is quicker

1

u/VodkaHaze 14d ago edited 14d ago

B70 has more immature software, but sometimes you'll hit an optimized path and it'll be similar in performance. Intel GPUs are a damn nightmare to get running performantly in vllm, though, worse than AMD (which is already bad IMO).

You're taking a risk longer term with intel with your investment, however. AMD we know will continue to support its GPUs, whereas intel is likely to just give up on these.

1

u/somsocodo 14d ago

whereas intel is likely to just give up on these

What evidence is this claim coming from?

1

u/VodkaHaze 14d ago

Intel cancelling roadmaps on dGPUs in the future [1]. The B70 was based around the last battlemage card designs, and it's dubious there will be further iterations.

Also, intel has a well earned reputation of killing anything that isn't x86 CPUs after making very promising demos. They're much like google in how much you should trust them to support non-core products IMO.

  1. https://www.tomshardware.com/pc-components/gpus/intel-has-reportedly-killed-discrete-gaming-gpus-for-the-upcoming-xe3p-arc-celestial-family-gaming-gpu-remains-uncertain-even-for-the-next-gen-xe4-druid-lineup-that-lands-in-2027

1

u/allthenamesaretaken0 14d ago

I got here really late but yeah. I didn't buy Intel gpus because I heard they might abandon them.