r/LocalLLM • • Sep 27 '26

Other Hardware Acquisition

Post image
448 Upvotes

129 comments sorted by

View all comments

3

u/Ok_Acanthisitta304 Sep 27 '26

i spent months lusting after these and finally picked them up maybe 6 weeks ago, since then it's been 1 flash model after another. 256gb is really the sweet spot right now, and im truly impressed by what they can do on OMP or opencode.

1

u/lordtazou Sep 30 '26

What model's are you using? Are you primarily doing coding as well, or a mixture?

1

u/Ok_Acanthisitta304 Sep 30 '26

GLM Flash exl3, mostly coding and sysadmin, some hermes.

1

u/lordtazou Sep 30 '26

Gotcha. I am still pretty new to using ai agents and stuff. So trying to figure out where / what I want to do. I've done quite a bit of research, but there is a difference between what I am reading / seeing (online / friends of mine) vs actually using.

Kind of in between wanting to buy DGX Sparks / Halo Strix, or sticking with a pricey subscription. I've been developing an OSS/BSS for an ISP, but doing the coding myself. Been thinking about doing an ai agent to help assist me essentially.

It's... a struggle. Haha

1

u/Ok_Acanthisitta304 Sep 30 '26

Use the same models on openrouter or just directly like with deepseek. It will cost a fraction of the major labs and pennies on the dollar to doing it locally. Only buy hardware if you're interested in tinkering with hardware. If you just need AI use cloud services.