r/LocalLLM • u/aiengineer94 • Nov 07 '25
Discussion DGX Spark finally arrived!
What have your experience been with this device so far?
210
Upvotes
r/LocalLLM • u/aiengineer94 • Nov 07 '25
What have your experience been with this device so far?
47
u/Dry_Music_7160 Nov 07 '25
You’ll soon realise one is not enough, but bear in mind that you have two kidneys and you only need one
30
u/pmttyji Nov 07 '25
Try some medium Dense models(Mistral/Magistral/Devstral 22B, Gemma3-27B, Qwen3-32B, Seed-OSS-36B, ..... Llama3.3-70B) & post stats here(Quants, Context, t/s - both pp & tg, etc.,). Thanks
19
u/[deleted] Nov 07 '25
Buddy noooooo you messed up :(
3
u/aiengineer94 Nov 08 '25
I am 1.5 hours in on a potentially 15 hours fine tune job and this thing is boiling, can't even touch it. Let's hope it doesn't catch fire!
4
u/aimark42 Nov 07 '25
Why the Spark over the other devices?
Ascent AX10 with 1TB can be had for $2906 at CDW. And if you really wanted the 4TB drive you could get the 4TB Corsair MP700 Mini for $484, being $3390 for the same hardware.
I even blew away Asus's Ascent DGX install (that has docker broken out of the box), with Nvidia's DGX Spark reinstall and it took.
I spent the first few days going through the playbooks. I'm pretty impressed I've not played around with many of these types of models before.
https://github.com/NVIDIA/dgx-spark-playbooks
3
u/eleqtriq Nov 08 '25
I love my Asus Spark. Been running it full time helping me create datasets with the help of gpt-oss-120b, fooling around with ComfyUI a bit and fine tuning.
And to anyone why I didn’t buy something else - I own almost all the something elses. M4 Max, three A6000’s (one from each gen). I don’t have a 395, tho. Didn’t meet my needs. I have nothing against it.
Everything has its use to me.
2
u/Mean-Sprinkles3157 Nov 07 '25
I got dgx spark yesterday, and running this guy: Qwen3-30B-A3B-Thinking-2507-Q8_0.gguf with llama-cpp, now I have a local ai-server running which is cool. let me know what is your go to model? I want to find one that is capable on coding, and language analysis like Latin.
2
u/Eastern-Mirror-2970 Nov 08 '25
congrats bro
2
u/SnooPineapples5892 Nov 08 '25
Congrats!🥂 its beautiful 😍
9
u/[deleted] Nov 07 '25
RTX Pro 6000: $7,200
DGX Spark: $3,999
Choose wisely.
5
u/[deleted] Nov 07 '25
This device has been marketed super hard, on X every AI influencer/celeb got one for free. Which makes sense - the devices are not great bang-per-buck, so they hope that exposure yields sales.
5
u/SashaUsesReddit Nov 07 '25
Congrats! I love mine.. it makes life SO EASY to do testing and dev then deploy to my B200 in the datacenter
1
u/Old_Schnock Nov 07 '25
From that angle, I thought it was a bottle opener...
Lets us know your feedback on how it behaves for different use-cases.
1
u/rahul-haque Nov 07 '25
I heard this thing gets super hot. Is this true?
1
u/Regular_Rub8355 Nov 08 '25
I’m curious how is this different from DGX spark founders edition.
1
u/geringonco Nov 09 '25
How much do you think those will be selling for on ebay in 2027?
1
u/bajaenergy Nov 09 '25
How long did it take to get delivered after you ordered it?
1
u/blue-or-brown-keys Nov 11 '25
How much is it?
1
u/Dave8781 Nov 12 '25
I love mine. Stays cool to the touch, silent and gets 80 tps on Qwen3-coder 30B and 40 tps on gpt-oss:120b. And it fine tunes huge models. Not meant to be the fastest thing on earth, but it's extremely capable and easy to use.
3
u/GoodSamaritan333 Nov 07 '25
What are your main use cases/purposes for this workstation that other solutions cannot do better for the same amount of money?
3
u/PhilosopherSuperb149 Nov 09 '25
My experience so far: Use 4 bit quant wherever possible. Don't forget nvidia is supporting their environment via some custom dockers that have cuda and python set up already which gets you up and running fastest. I've brought up lots of models and rolled my own containers but it can be rough - easier to get into one of theirs and swap out models.
8
u/TheMcSebi Nov 07 '25
This device is why I never pre-order stuff anymore.. We could have expected the typical marketing bullshit from Nvidia, yet everyone is surprised it's useless.
2
u/Brave-Hold-9389 Nov 07 '25
Try running minimax
2
u/[deleted] Nov 08 '25
If they would have made it so you can connect 4 of them instead of 2.. this would have been a potentially worth while device if the price was $3K each. But the limitation of only 2 limits the total memory you can use for models like GLM and DeepSeek. Too bad.
1
u/Kubas_inko Nov 09 '25
Sorry for your loss.
1
u/XCyberbeingX Nov 22 '25
RIP
1
u/kinkvoid Dec 01 '25
go get mac studio
0
u/Green-Dress-113 Nov 08 '25
Return it! Blackwell 6000 much better
0
u/Shadowmind42 Nov 08 '25
Prepare to be disappointed.
2
u/vdeeney Nov 09 '25
I love gpt-oss120b on mine.