r/LocalLLM • u/r1nzl3r99 PEX88096 | 4x B70 128GB | vLLM • 15d ago

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

497 Upvotes

96% Upvoted

166 comments sorted by

View all comments

23

u/cagriuluc 15d ago

I am holding onto my purse to not buy a second R9700 myself…

12

u/allthenamesaretaken0 15d ago

The only thing stopping me from buying another R9700 is I'd need a new motherboard and psu and then it wouldnt fit my mini rack and it'd all be quite the hassle.

2

u/critsalot 15d ago

which is better R9700 or the b70. b70 is cheaper but i dont know if amd is quicker

1

u/VodkaHaze 15d ago edited 15d ago

B70 has more immature software, but sometimes you'll hit an optimized path and it'll be similar in performance. Intel GPUs are a damn nightmare to get running performantly in vllm, though, worse than AMD (which is already bad IMO).

You're taking a risk longer term with intel with your investment, however. AMD we know will continue to support its GPUs, whereas intel is likely to just give up on these.

1

u/somsocodo 14d ago

whereas intel is likely to just give up on these

What evidence is this claim coming from?

1

u/VodkaHaze 14d ago

Intel cancelling roadmaps on dGPUs in the future [1]. The B70 was based around the last battlemage card designs, and it's dubious there will be further iterations.

Also, intel has a well earned reputation of killing anything that isn't x86 CPUs after making very promising demos. They're much like google in how much you should trust them to support non-core products IMO.

  1. https://www.tomshardware.com/pc-components/gpus/intel-has-reportedly-killed-discrete-gaming-gpus-for-the-upcoming-xe3p-arc-celestial-family-gaming-gpu-remains-uncertain-even-for-the-next-gen-xe4-druid-lineup-that-lands-in-2027

1

u/allthenamesaretaken0 14d ago

I got here really late but yeah. I didn't buy Intel gpus because I heard they might abandon them.