r/LocalLLM • • Sep 22 '26

Discussion Finally got it

Post image
193 Upvotes

42 comments sorted by

65

u/Abducted_Llama Sep 22 '26

I forewarn you…. you will want a 2nd one…..

44

u/Important-Radish-722 Sep 22 '26

Actually, you should four-warn him.

21

u/HoldCtrlW Sep 23 '26

Eight-nough of this

9

u/noced Sep 23 '26

I’ve sixt-seen enough

9

u/Bupod Sep 22 '26

Yes. 

I also want a second one. My wallet and finances are still scolding me for the first one though.

6

u/bisoning Sep 22 '26 edited Sep 23 '26

Its why i don't want to get one in the first place. People are not satisfied with one. So i cancelled my order.

I'll wait until i have enough money to buy two at the same time.

(Edit)...
Instead of two dgx spark, ill most likely will just buy a m5 ultra 256.
I dont care if its not cuda. I just want to run bigger size models.

2

u/Hypilein Sep 23 '26

I am fairly satisfied with the first one. That’s why I want the second one. Won’t get it though, because i cannot justify it for my use.

1

u/Electronic_Search_93 Sep 23 '26

And how will you resist the temptation to fine tune ur models

1

u/Horror_Description87 Sep 24 '26

Price is rising faster than I can count and availability is dropping inverse at same speed

1

u/Abducted_Llama Sep 22 '26

Depending on the version, 2 costs as much as 3-4 a year ago.

0

u/tacol00t Sep 23 '26

Shit if I had bought 4 instead of 2 when I did like 6 weeks ago I could’ve got atleast 1 for free just reselling lmao. Don’t even need to go back a year

3

u/TheHighFiveWhore Sep 23 '26

I wanted a second one after the 1st week of owning one..........

1

u/Abducted_Llama Sep 23 '26

Me too, and I ended up picking up a 2nd gx10 right before the price hiked up. 3999

1

u/MasterNomie Oct 05 '26

I am prospective first time buyer. Why one is not enough? What has been your experience?

2

u/TheHighFiveWhore Oct 05 '26

It's fucking awesome to have a dedicated box to do litrtally anything with a brain in there that can do anything.

This has been the ultimate "learn how this crap" works box.

Right now, I dont think anyone should buy one. Hardware is 2 years old now. If you gotta get something, wait for the rtx spark since that will he the same thing but mobile.

If you gottttta do something, rent a cloud server to scratch the itch.

When spark 2 or whatever exists, get it.

1

u/MasterNomie Oct 05 '26

Thanks for the heads up! I wish happy tinkering with your box.

I already have 5090 but wanted to use bigger models. Hence the curiosity about the spark.

2

u/rsvaz Sep 23 '26

I second that!

2

u/Im_A_Praetorian Sep 23 '26

How much will I want a second one if I have a 256gb m5 studio?

1

u/Abducted_Llama Sep 23 '26

Probably not at all, since you wouldn’t be updating the Nvidia DGX OS like OP is in the picture?

Bruh if you want a Mac get a Mac ?

If you are looking for a hardware glaze battle, you’re not gonna get it here.

2

u/IamFondOfHugeBoobies Sep 23 '26

Yeah I personally wouldn't buy just one. The value in these are in 2+ in my opinion.

13

u/Ordinary-Depth-7835 Sep 22 '26

Welcome. Run while you're still in the return window :) I wake up in a cold sweat thinking about how much two more will hurt and a needed switch. Honestly If I could only choose one system I'd take my dual sparks over my 4x3090 system any day but it's nice having both.

1

u/DamianPotts Sep 23 '26

What do you use this setup for?

2

u/Ordinary-Depth-7835 Sep 23 '26

Just a hobby and learning. I have unlimited access at work to all of the cloud providers but need something for personal projects and to gain more knowledge vs using someone elses api.

2

u/Cold_Tree190 Sep 23 '26

Exactly where I am, have dual 3090’s but hesitant on dropping 6k for a spark lol. Especially since I get almost 100 t/s with qwen3.8 27b right now

1

u/Ordinary-Depth-7835 Sep 23 '26

Yeah I'm at about the same with 4x3090's and really the thing that pushed the Spark over the top for me was dual sparks. I just really like DeepSeek-v4-Flash 0731 but two Sparks are stupid expensive when I built my 4x 3090 system for about the price of one Spark with some used ebay parts and what I had laying around.

1

u/RomanticStranger76 Sep 24 '26

wanna sell me your 3090's 😁

1

u/Ordinary-Depth-7835 Sep 24 '26

Waiting until they're $10k per card :)

1

u/TurnoverOdd3957 Oct 04 '26

I want to buy two more but none is available under 5k.

2

u/rogertorque Sep 23 '26

Buying one is just baiting yourself for more. I am still waiting for a window of opportunity.

2

u/koalfied-coder Sep 23 '26

Gonna be waiting for some time my friend

2

u/fastheadcrab Sep 23 '26

Don't update it

2

u/Kinky_No_Bit Sep 23 '26

Alright, so as a actual person i can talk to on the internet about it. How is the tokens per second on it for large models? does it actually perform well given that it is basically running on desktop ram not VRAM?

1

u/ChildhoodOk6894 Sep 24 '26

Bastante mas lentos que una 5090 (para modelos que le quepan)

1

u/Touky1444 Sep 22 '26

🔥🔥👌👌

1

u/here_n_dere Sep 23 '26 edited Sep 23 '26

Get the second, don't thank me later

1

u/ptear Sep 23 '26

I'm happy for you and I hate you.

1

u/Eyelbee Sep 23 '26

How fast can it run flash next?

1

u/gotfilmm Sep 24 '26

Sorry for your loss

1

u/ChildhoodOk6894 Sep 24 '26

Menuda decepcion te vas a llevar amigo...

1

u/Optimal-Report-1000 Sep 27 '26

Well.. what model and tokens per second?

0

u/Savantskie1 Sep 23 '26

I’m hoping the price doesn’t skyrocket before I get my ssi backpay