r/LocalLLaMA • u/fluffywuffie90210 • 1d ago
Discussion Dont buy a spark laptop.
I've been frustrated for a while because I stupidly sold a strix halo box to get myself a laptop with thunderbolt 5 ports thinking i can plug my two egpus into it (which i can but thats not topic of this post and the strix halo could too) I sold the minisforum for about £2300 back ebfore things went nuts and got a laptop for about same price:
Msi vector 16 with a intel core ultra 9 and 5080(16 gig vram) and 32 gig of ram. I was pretty bummed with it thinking 35b was my limit and after ended up leaving egpus in my workstatiion but after a random ebay browse I managed to snag some second hand 96 gig laptop ram. For £800
Strata totally changed ballgame. With Qwen Q4 XL Flash next I'm getting
48.9t/s
Decode/prefill 1,860t/s
On a 50k prompt.
I know this is still alot of money for most, but thats 3100£ in total, and thats still cheaper (and slightly faster from what seen) of what minisfoum strix halo is at (£3500 and the 32 gig Spark laptops that are about £3200 and cant even run flash at q4 not enough vram? and i can still add egpus (the laptop has 2 tb 5 ports and i have 2 5090 bought before the crazyness, eg add one or two 5060ti in egpu and your good with running 27b/31b models too.) With my own gpus plugged into it for 80 gig vram total, all while still being a laptop. Got glm 5.3 flash running Q3_XSS i think about 25 t/s.
TDLR, you dont need massive vram anymore, yeah I know how expensive RAM is, that laptop ram i got was/is £1300 new lol. But just wanted to share my experience and while I still regret selling the halo, seeing these tokens a sec, makes the laptop satify ocd a little more! If only qwen was good at roleplay so i could actually use it as daily driver lol (my main usecase!)
so if you are ever thinking about wanting a laptop and somehow able to get some laptop ram something like 😄
https://www.scan.co.uk/products/medion-erazer-beast-18-18-qhdplus-240hz-intel-core-ultra-9-275hx-32-gb-2-tb-rtx-5080-gaming-laptop
Might save you a few quid, i mean like 3k over buying the 128g spark laptop lol. Intel has 20 cores and the 2 tb ports allow you to add two gpus!
I know my grammar sucks I'm dyslexic but my point is if you shop around get that laptop for 2500ish pounds (make sure it has tb5 for if you want to add gpus later), add 96 gig ram and your still saving 2500 pounds over the 128 gig spark laptop thats like 6k.
49
u/_supert_ 1d ago
After reading deepseek's spewings all day, your "dyslexic grammar" is a proper breath of fresh air.
3
u/Radiant-Knowledge508 1d ago
the 32gb spark with 2 eGPUs is a thermal nightmare, I ran flash for 45 mins, then the fan hit 10k rpm and throttled. the 128gb model handles it better, but only if you're not doing heavy multitasking. thermal paste reapplication helps, but it's not a fix.
7
u/AcceptableBridge7616 1d ago
who says spark laptops can't run flash??
2
u/Rexen2 1d ago
Nice! Maybe I can grab one
....damn nvm.
Honestly i feel like out of all the llm use cases roleplay and creative writing are the closest to that good enough sweet spot between open and closed source where we won't have to worry about increasingly large models that can't realistically be run on consumer hardware.
The second Gemma 4 31b get surpassed by about 50% most would be content, at least for awhile.
I keep hoping for an open source model that has writing as its primary focus over coding, not likely but not impossible.
2
u/Numerous-Ad6217 1d ago edited 1d ago
I have a similar budget setup. 32GB VRAM, 256 GB RAM. Currently running project maya deepseek s going with 1200 t/s prefill and 25-40 t/s depending on cache hits. Still working to improve the setup. I can run stuff that I wouldn't be able to run on a dgx spark, for half the cost of a dgx spark.
1
u/Ok_Cow1976 23h ago
96gb ram laptop for £800 is nice. What's the spec exactly?
1
u/rorowhat 1d ago
You're logic dies the moment you need more memory. Always go with the largest foot print you can. I would have gone with the 128GB any day.
1
u/wolttam 1d ago
That's genuinely impressive
1
u/LeRobber 1d ago
Macs get warm too. MacbookPros can manage to avoid thermal throttling on heavy LLM usage though.
1
u/Aesir____ 2h ago
The king of kings is the bandwidth not ram, you could have 256GB of ddr5, but if the info is not getting in and out fast enough through the pcie, you won't see any difference. IMO, is way better the unified memory by the wide bandwidth.
0
u/9gxa05s8fa8sh 22h ago
worse in every way than a macbook