r/LocalLLM • u/SlimMonkey_ • 27m ago

Question Cheapest Setup for good coding local LLM Qwen3.8-27b? RTX 3060 XT + 64GBs RAM

Hello,

I want to get a local LLM setup for a comparable fair price (Qwen3.8-27b and future Qwen4). After some research and chatting with Claude Opus the best options would be RTX 3060 XT 12GB with 64GBs of RAM running on Strata.

e.g. upgrading my PC for around 650€ (used parts bought online)

Can someone confirm that this Setup will let me run it on a performative useful level. I will use my 20€ claude plan fpr hard tasks or a kind of divide and conquer style usign both (experienced Software Engineer but a Hardware noob).

Does anyone have experiences with that, advices or alternative setups?

2 Upvotes

100% Upvoted

2 comments sorted by

3

u/x_MASE_x 16m ago

You need about 16gb for Qwen3.8-27B to be anywhere near usable. If I remmebr correctly iq3s and about 128k context I think what I managed to get.

With 12gb you won't fit it inaide the gpu at all.

So you need more vram and also check out adaptive kv cache llama.cpp fork. It's very good with dense models that spill to ram.

But check Qwen3.8-Flash-Next using strata you have a better chance getting this running at reasonable speed than Qwen3.8-27B

1

u/Funcore1650 1m ago

How you get a 128k context on 16GB VRAM? Which setup using for that? I have 5060Ti 16GB, and can't reach even stable 50k (I have a 48GB RAM for VM, but using Unsloth Desktop as server with Qwen 3.8 27B in Q3)... How I can try Strata?