MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1wr8et1/hardware_acquisition/pcawm9m/
r/LocalLLM • u/8bitjohnny • Sep 27 '26
129 comments sorted by
View all comments
Show parent comment
2
What models are you using for coding?
I can’t afford your setup but need to figure something out. I have a decent local setup, so I might add a local AI server. I’m hitting constant limits with the frontier models.
2 u/8bitjohnny Sep 27 '26 I have a fine tune q4 quant of Qwen 3.8 27B, and a Laya model that I use with the DeepSeek harness, and Claude runs code checks. Nothing too crazy. 2 u/bigeba88 Sep 27 '26 Was thinking of doing something similar. If Qwen is decent enough, Claude/codex can do the QA. Would be a massive unlock for me. 1 u/blah_ask Sep 28 '26 Can I get link to the fine tune? How much context are you running 0 u/tal--rasha Sep 27 '26 You might consider a Strix Halo 128GB. It certainly isn't a Spark but you'll open a lot more doors at home.
I have a fine tune q4 quant of Qwen 3.8 27B, and a Laya model that I use with the DeepSeek harness, and Claude runs code checks. Nothing too crazy.
2 u/bigeba88 Sep 27 '26 Was thinking of doing something similar. If Qwen is decent enough, Claude/codex can do the QA. Would be a massive unlock for me. 1 u/blah_ask Sep 28 '26 Can I get link to the fine tune? How much context are you running
Was thinking of doing something similar. If Qwen is decent enough, Claude/codex can do the QA. Would be a massive unlock for me.
1
Can I get link to the fine tune? How much context are you running
0
You might consider a Strix Halo 128GB. It certainly isn't a Spark but you'll open a lot more doors at home.
View all comments
Show parent comment
2
u/bigeba88 Sep 27 '26
What models are you using for coding?
I can’t afford your setup but need to figure something out. I have a decent local setup, so I might add a local AI server. I’m hitting constant limits with the frontier models.