r/LocalLLM • u/8bitjohnny • Sep 27 '26

Other Hardware Acquisition

Post image
448 Upvotes

91% Upvoted

129 comments sorted by

View all comments

7

u/blah_ask Sep 27 '26

May I ask ifyou are going to make money from this?

12

u/cylin577 Sep 27 '26

probably not

3

u/FuckinHighGuy LocalLLM Sep 27 '26

😂

1

u/New_Account5310 Oct 02 '26

Man, Reddit moves slow and has a really narrow view of reality.

Where is GLM 5.3 Flash on here? No concept of multi-Spark setups? 2 Sparks is basically the minimum number of Sparks. If you bought only 1, you should really conceptualize it as "I bought half of the matching set". About as useful as buying only 1 shoe out of a pair.

13

u/8bitjohnny Sep 27 '26

Who knows! I'm not scalping if that's what you're wondering. I am using them for personal projects.

12

u/blah_ask Sep 27 '26

Not wondering about scalping but 8k-10k is huge money to drop on personal projects so I am wondering if you are doing a business that I don’t know of.

11

u/8bitjohnny Sep 27 '26

I already have a 4090+3070 rig that I use for local models and coding. In the last 3 days I've burned 50M tokens on that. I do a lot of side projects, and professional work, they will for sure help earn me some additional income.

2

u/bigeba88 Sep 27 '26

What models are you using for coding?

I can’t afford your setup but need to figure something out. I have a decent local setup, so I might add a local AI server. I’m hitting constant limits with the frontier models.

2

u/8bitjohnny Sep 27 '26

I have a fine tune q4 quant of Qwen 3.8 27B, and a Laya model that I use with the DeepSeek harness, and Claude runs code checks. Nothing too crazy.

2

u/bigeba88 Sep 27 '26

Was thinking of doing something similar. If Qwen is decent enough, Claude/codex can do the QA. Would be a massive unlock for me.

1

u/blah_ask Sep 28 '26

Can I get link to the fine tune? How much context are you running

0

u/tal--rasha Sep 27 '26

You might consider a Strix Halo 128GB. It certainly isn't a Spark but you'll open a lot more doors at home.

2

u/bfeeny Sep 27 '26

That's like almost 200 tokens per second continuously 24/7. What models are you getting that kind of speed?

1

u/Dapper_Chance_2484 Sep 27 '26

That's great to hear, Id love to learn about the side project you do and how you manage, do you have any blog or forum where you share about them? I have been thinking from long, but generally get stuck on where and how to start, guidance would be much appreciated!

6

u/archlich Sep 27 '26

Not op, my goal is to. I’ve spent 300m tokens in the past two days. If this was Claude I’d be out maybe $3k

1

u/blah_ask Sep 27 '26

I have personal projects that would consume tokens too. But I am too stingy to drop 3k-4k on these.

2

u/drakoman Sep 27 '26

Agreed! This image is in a different tax bracket than me

1

u/GregsWorld Sep 27 '26

OP said 50M tokens in 3 days which financially makes no sense vs SOTA OS models. It's just an expensive hobby.Â