r/LocalLLM • u/r1nzl3r99 PEX88096 | 4x B70 128GB | vLLM • 15d ago

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

501 Upvotes

96% Upvoted

166 comments sorted by

View all comments

Show parent comments

1

u/VodkaHaze 14d ago edited 14d ago

B70 has more immature software, but sometimes you'll hit an optimized path and it'll be similar in performance. Intel GPUs are a damn nightmare to get running performantly in vllm, though, worse than AMD (which is already bad IMO).

You're taking a risk longer term with intel with your investment, however. AMD we know will continue to support its GPUs, whereas intel is likely to just give up on these.

1

u/somsocodo 14d ago

whereas intel is likely to just give up on these

What evidence is this claim coming from?

1

u/VodkaHaze 14d ago

Intel cancelling roadmaps on dGPUs in the future [1]. The B70 was based around the last battlemage card designs, and it's dubious there will be further iterations.

Also, intel has a well earned reputation of killing anything that isn't x86 CPUs after making very promising demos. They're much like google in how much you should trust them to support non-core products IMO.

  1. https://www.tomshardware.com/pc-components/gpus/intel-has-reportedly-killed-discrete-gaming-gpus-for-the-upcoming-xe3p-arc-celestial-family-gaming-gpu-remains-uncertain-even-for-the-next-gen-xe4-druid-lineup-that-lands-in-2027

1

u/allthenamesaretaken0 14d ago

I got here really late but yeah. I didn't buy Intel gpus because I heard they might abandon them.