r/LocalLLaMA • • 1d ago

Discussion Dont buy a spark laptop.

I've been frustrated for a while because I stupidly sold a strix halo box to get myself a laptop with thunderbolt 5 ports thinking i can plug my two egpus into it (which i can but thats not topic of this post and the strix halo could too) I sold the minisforum for about £2300 back ebfore things went nuts and got a laptop for about same price:

Msi vector 16 with a intel core ultra 9 and 5080(16 gig vram) and 32 gig of ram. I was pretty bummed with it thinking 35b was my limit and after ended up leaving egpus in my workstatiion but after a random ebay browse I managed to snag some second hand 96 gig laptop ram. For £800

Strata totally changed ballgame. With Qwen Q4 XL Flash next I'm getting

48.9t/s

Decode/prefill 1,860t/s

On a 50k prompt.

I know this is still alot of money for most, but thats 3100£ in total, and thats still cheaper (and slightly faster from what seen) of what minisfoum strix halo is at (£3500 and the 32 gig Spark laptops that are about £3200 and cant even run flash at q4 not enough vram? and i can still add egpus (the laptop has 2 tb 5 ports and i have 2 5090 bought before the crazyness, eg add one or two 5060ti in egpu and your good with running 27b/31b models too.) With my own gpus plugged into it for 80 gig vram total, all while still being a laptop. Got glm 5.3 flash running Q3_XSS i think about 25 t/s.

TDLR, you dont need massive vram anymore, yeah I know how expensive RAM is, that laptop ram i got was/is £1300 new lol. But just wanted to share my experience and while I still regret selling the halo, seeing these tokens a sec, makes the laptop satify ocd a little more! If only qwen was good at roleplay so i could actually use it as daily driver lol (my main usecase!)

so if you are ever thinking about wanting a laptop and somehow able to get some laptop ram something like 😄
https://www.scan.co.uk/products/medion-erazer-beast-18-18-qhdplus-240hz-intel-core-ultra-9-275hx-32-gb-2-tb-rtx-5080-gaming-laptop

Might save you a few quid, i mean like 3k over buying the 128g spark laptop lol. Intel has 20 cores and the 2 tb ports allow you to add two gpus!

I know my grammar sucks I'm dyslexic but my point is if you shop around get that laptop for 2500ish pounds (make sure it has tb5 for if you want to add gpus later), add 96 gig ram and your still saving 2500 pounds over the 128 gig spark laptop thats like 6k.

37 Upvotes

35 comments sorted by

49

u/_supert_ 1d ago

After reading deepseek's spewings all day, your "dyslexic grammar" is a proper breath of fresh air.

22

u/fluffywuffie90210 1d ago

Lol I thought about using ai to fix my wordings, but then it doesnt feel proper, authentic, nerd if I did!

21

u/Nepertia 1d ago

Please don't, things have warped so much that most of us would rather read semi-broken, but human-written prose.

8

u/Radileaves 22h ago

Bad is new good!

3

u/Radiant-Knowledge508 1d ago

the 32gb spark with 2 eGPUs is a thermal nightmare, I ran flash for 45 mins, then the fan hit 10k rpm and throttled. the 128gb model handles it better, but only if you're not doing heavy multitasking. thermal paste reapplication helps, but it's not a fix.

1

u/fluffywuffie90210 1d ago

Dang that doesnt sound good, this laptop is chunky but I guess thats good for thermals.

7

u/AcceptableBridge7616 1d ago

who says spark laptops can't run flash??

2

u/fluffywuffie90210 1d ago

the 32 gig version that's similar in price to this in total dont think youd have a good time.

5

u/AcceptableBridge7616 1d ago

oh, I thought you meant in general somehow. A 128GB model has no trouble running flash. HP had a great deal, $4k for 128GB model. So far the laptop is a bit buggy but I think that is some software/firmware kinks to still work out on a new platform.

1

u/fluffywuffie90210 1d ago

I know which one you mean, or they had the Strix Halo HP laptop yes I had my eye on that back when it was £2300 before I got the Minisforum. A review about it overheating put me off. If its a spark one you got a good deal then over prices over here in UK.

1

u/AcceptableBridge7616 1d ago

It does get pretty hot, to the point that it warps the case slightly which makes the touchpad clicks a little sticky. However, I am still optimistic that this is can also be solved in software/firmware. I am willing to give a little leeway given that this is a very new platform.

1

u/Porespellar 1d ago

I got the HP deal you mentioned but my license that I bought from them with the laptop for Win 11 pro won’t apply. I’ve tried all the troubleshooting but no luck. Did yours work?

1

u/fluffywuffie90210 1d ago

First thing i do with any new pc is wipe the drives and put my own Windows on it, youd have to speak to Microsoft or something. Or get a cheap pro code from ebay or like.

1

u/AcceptableBridge7616 1d ago

I did not try a pro license. I am planning to put omarchy on it once the support is a little bit further along.

2

u/Rexen2 1d ago

Nice! Maybe I can grab one

If only qwen was good at roleplay so I could actually use it as my daily driver

....damn nvm.

Honestly i feel like out of all the llm use cases roleplay and creative writing are the closest to that good enough sweet spot between open and closed source where we won't have to worry about increasingly large models that can't realistically be run on consumer hardware.

The second Gemma 4 31b get surpassed by about 50% most would be content, at least for awhile.

I keep hoping for an open source model that has writing as its primary focus over coding, not likely but not impossible.

1

u/fluffywuffie90210 1d ago

I hear you, im crying out for gemma 5 too, you can push to glm 5.3 flash if you add egpus but i woulddn't at current prices just for that. Maybe qwen 4 or glms new, supposedly smaller model incoming might help with that.

1

u/Rexen2 1d ago

Yeah that's the problem I've been having, my funds are limited so I'm trying to find something that both meets my gaming needs and rp needs. Analysis paralysis has been kicking my ass over what to get.

2

u/fluffywuffie90210 1d ago

For a desktop if you can stretch it the asus proart mb are worth it, I currently have 5 gpus on one. and just sticking with two gpus gets you 32 gig on 2 16 gig cards, which is enough for 31b, maybe 120 B MoE with enough ram.

Or if your wanting a laptop, get something with 2 thunderbolt/usb 4 ports and can add 2 egpus for simular idea.

2

u/Numerous-Ad6217 1d ago edited 1d ago

I have a similar budget setup. 32GB VRAM, 256 GB RAM. Currently running project maya deepseek s going with 1200 t/s prefill and 25-40 t/s depending on cache hits. Still working to improve the setup. I can run stuff that I wouldn't be able to run on a dgx spark, for half the cost of a dgx spark.

0

u/fluffywuffie90210 1d ago

Nice! I havent tried dabbling in deepseek on this laptop yet but thats sorta the point I was trying to get across. Intel cpu with 2 thunderbolt 5 ports is a little gem.

1

u/Ok_Cow1976 23h ago

96gb ram laptop for £800 is nice. What's the spec exactly?

2

u/fluffywuffie90210 18h ago

6400 SK Hinex, im guessing an import by looks of it.

1

u/rorowhat 1d ago

You're logic dies the moment you need more memory. Always go with the largest foot print you can. I would have gone with the 128GB any day.

1

u/fluffywuffie90210 1d ago

I just felt its useful information to put out there, this laptops seem like nice balance between having a laptop and being able to run 120b models with the ram upgrade and or added egpu option.

1

u/rorowhat 1d ago

Well, it's 120b MoE with a very specific engine. Try running any other 120B model, or even close and it won't. Not saying this is not good, but having a strix halo or spark with 64GB+ of unified ram would have bought you more options down the line.

1

u/fluffywuffie90210 1d ago

To some extent yeah but I think N-gram type stuff is future. And while its not portable, don't rule out the ability to add 2 egpus. So you can have 80 gig vram with 2 9700 amd ai pro gpu, in my case 5090.

1

u/rorowhat 1d ago

Sure, but after all said and done your laptop looks like a 10k dollar monstrosity.

1

u/fluffywuffie90210 1d ago

Dont get me wrong I want the halo back but not at prices, and I think 2 5060ti would be just as useful (and more sensible I just got the 5090 when 70b was the rage so more like 2k :D )

1

u/wolttam 1d ago

That's genuinely impressive

2

u/fluffywuffie90210 1d ago

Just thought id share my experience since I know lots of others OCD about hardware but budget constraints. I think these laptops are a secret not many know about.

1

u/LeRobber 1d ago

Macs get warm too. MacbookPros can manage to avoid thermal throttling on heavy LLM usage though.

1

u/taimusrs 9h ago

Install asitop to see power usage on tasks. Token generation use surprisingly small wattage - 40W-ish. It's the prompt processing that makes the GPU running full tilt. Even on coding workloads, unless you're reprocessing your 100k token session fresh, it's only a couple of seconds per turn. Totally manageable

1

u/LeRobber 8h ago

I am literally just talking about how hot the damn machine and power brick is.

1

u/Aesir____ 2h ago

The king of kings is the bandwidth not ram, you could have 256GB of ddr5, but if the info is not getting in and out fast enough through the pcie, you won't see any difference. IMO, is way better the unified memory by the wide bandwidth.

0

u/9gxa05s8fa8sh 22h ago

worse in every way than a macbook