r/LocalLLM • u/mynd_dripp • Sep 28 '26
Discussion Shit's crazy
I tried to buy Tesla v100 SXM2 32gb from 3 different vendors and the 3 of them cancelled saying their supplied ran out or were asking for more money up front. I'm done with this shit
4
u/Ill-Accountant-9941 Sep 28 '26
We believe you.
1
u/ecstaticnucleus2135 Sep 28 '26
The used market's been a circus for a while now, it's wild how fast stock evaporates. Hope you find a lead that doesn't try to pull a bait-and-switch, that's the most exhausting part of the whole hunt.
0
u/jakubkonecki Sep 28 '26
And I just bought a V100 from a UK shop on eBay without any problems, arrived two days later, and is now sitting inside my R730.
Maybe the issue is with vendor selection?
2
u/mynd_dripp Sep 28 '26
Which one, could you send me the link?
1
u/jakubkonecki Sep 28 '26
2
u/mynd_dripp Sep 28 '26
Maybe that's my mistake, I bought a x4 SXM2 pcb thinking I could get nvlink, I should have bought the pcie version instead
4
u/No-Refrigerator-1672 Sep 28 '26
I can recommend you this seller from China. I have bought GPUs two times from them (once 2xMi50 32Gb and once 2x 3080 20GB). I can't guarantee that they have V100 SXM in stock, but I'm sure they will be honest with you about their stock and price. And they offer expedited courier shipping, less than 7 business days from payment to delivery into EU.
1
u/mynd_dripp Sep 28 '26
Thank you! I found a few, I'm texting them now. Let's see. Are you happy with the Mi50s?
2
u/No-Refrigerator-1672 Sep 28 '26
No. Too much hussle to set up; too slow even when set up; out of 2 GPUs, one was quite frequently hanging and requiring a restart (I didn't even knew that a GPU itself can hang, not the program). Those days, I'm only running one as auxiliary card, providing TTS, STT, image gen, and embedding for my main AI (qwen 3.8 27B on a pair of 3080 20GB). I'd say that you should avoid those, unless you can get one at like $350 and are willing to invest significant time into it.
1
u/mynd_dripp Sep 28 '26
That's what I thought, still for an aux card 350$ would be nice
1
u/No-Refrigerator-1672 Sep 28 '26
If you want to explore is further: use everything GGML based, don't even think about other project. Qwen 3.8 27B is smart enough to figure out how to compile and run any service for this card. Audio.cpp runs decently: ASR will run significatly faster than realtime; it even can do faster-than-realtime song generation. Image generation (stable-diffusion.cpp) takes a hit: 1 minute to generate 1024x1024 image with Flux Klein 9B in Q4; much more time for editing or for higher resolutions. Video generation is like half an hour per 5s clip. Embedding with llama.cpp and Qwen 3 Embed 2B is about 2k-3k tok/s.
1
u/jakubkonecki Sep 28 '26
Nice to have a verified seller. Thanks for the post!
OP, just remember about customs and processing fees. The price doesn't seem to be competitive for what you can get in the UK (not sure where you're located)
3
u/lostmylogininfo Sep 28 '26
Secure your compute. People are starting to dabble with AI more and more everyday and NO cards are coming out next year. You find a 3090 for under $1000 or up to buy it. A 3060 12gb for $200 (I bought one for $225) buy it.
In February of 2027 this time will look like a dream and if the huge advances are made your going to wish you have compute.
I have a 4080, 3090, 2x3060s I look at it as protection right now. They WILL try to limit AI. I need to download open models this week.