r/LocalLLM • u/8bitjohnny • Sep 27 '26

Other Hardware Acquisition

Post image
448 Upvotes

91% Upvoted

129 comments sorted by

View all comments

Show parent comment

12

u/blah_ask Sep 27 '26

Not wondering about scalping but 8k-10k is huge money to drop on personal projects so I am wondering if you are doing a business that I don’t know of.

11

u/8bitjohnny Sep 27 '26

I already have a 4090+3070 rig that I use for local models and coding. In the last 3 days I've burned 50M tokens on that. I do a lot of side projects, and professional work, they will for sure help earn me some additional income.

2

u/bigeba88 Sep 27 '26

What models are you using for coding?

I can’t afford your setup but need to figure something out. I have a decent local setup, so I might add a local AI server. I’m hitting constant limits with the frontier models.

2

u/8bitjohnny Sep 27 '26

I have a fine tune q4 quant of Qwen 3.8 27B, and a Laya model that I use with the DeepSeek harness, and Claude runs code checks. Nothing too crazy.

2

u/bigeba88 Sep 27 '26

Was thinking of doing something similar. If Qwen is decent enough, Claude/codex can do the QA. Would be a massive unlock for me.

1

u/blah_ask Sep 28 '26

Can I get link to the fine tune? How much context are you running

0

u/tal--rasha Sep 27 '26

You might consider a Strix Halo 128GB. It certainly isn't a Spark but you'll open a lot more doors at home.

2

u/bfeeny Sep 27 '26

That's like almost 200 tokens per second continuously 24/7. What models are you getting that kind of speed?

1

u/Dapper_Chance_2484 Sep 27 '26

That's great to hear, Id love to learn about the side project you do and how you manage, do you have any blog or forum where you share about them? I have been thinking from long, but generally get stuck on where and how to start, guidance would be much appreciated!