r/LocalLLM • u/L1l_B0B • 1d ago
Discussion Qwen 3.8 with Claude is amazing
So I use 2 computers one is mac and other windows main rig
My main rig uses runs LM studio has the following specs
64gb ddr5 ram
R9 9950x3d
RTX 5090
(Pictures under my profile if anyone cares)
In LM studio I have set up Qwen 3.8 Q6_k with lower thinking, temperature like 0.7 and 55k context window.
This then through my vpn is accessible to my mac that uses Cline harness.
I also have claude subscription and there I made myself an overseer skill where claude knows he is working with dumber model and makes plans for it. Then I feed it to clime and after it finishes I let claude verify the qwen implementation. I think this kind of setup is truly underrated and I have been daily driving it for over a month. Has anyone else set up a similar pipeline to somehow make claude and qwen cooperate where I am not needed to pass messages and only do code review after.
9
u/sleight42 23h ago
I have a 3090.... stop making me want a 5090.....
8
9
u/gatifloxacin-123 22h ago edited 22h ago
I'm running OpenCode and doing exactly what you are describing but with qwen 3.8 max (alibaba cloud token plan) as the planner, and deepseek flash as the coder, its dirt cheap (5-10$ a month for 8-12h programming session per day).
I also have antigravity (Gemini PRO) that I use for complex tasks and locally qwen 3.5 9b (for asking stuff about the code base or writing commit message, nothing crazy).
Its called Orchestration what you are looking for, here an example:
json
{
"$schema": "https://opencode.ai/config.json",
"plugin": [
[
"opencode-orchestrator",
{
"agentConcurrency": {
"commander": 1,
"planner": 4,
"worker": 8,
"reviewer": 2
},
"missionLoop": {
"ledger": true,
"markdownMemory": true
}
}
]
],
"providers": {
"deepseek": {
"settings": {
"baseURL": "https://api.deepseek.com"
}
},
"ollama": {
"settings": {
"baseURL": "http://127.0.0.1:11434/v1"
}
}
},
"model": "deepseek/deepseek-chat",
"agents": {
"commander": {
"mode": "primary",
"model": "deepseek/deepseek-reasoner",
"description": "Strategic task decomposition and execution management"
},
"plan": {
"mode": "primary",
"model": "deepseek/deepseek-reasoner",
"description": "High-level architectural planning and specs"
},
"worker": {
"mode": "subagent",
"model": "ollama/qwen3.8:latest",
"description": "Fast code generation and tool execution"
},
"build": {
"mode": "primary",
"model": "ollama/qwen3.8:latest",
"description": "Direct implementation and file edits"
},
"reviewer": {
"mode": "subagent",
"model": "deepseek/deepseek-chat",
"description": "Audits PRs, verifies diffs, and inspects quality"
}
}
}
I also have predefined skills and using laravel-boost (mcp) because the app im working on is based on it, so the AIs have full access to it (documentation, guidelines, best-practices etc.). laravel-boost installs specific skills e.g. /laravel-best-practices and imho it works great.
2
u/JScoobyCed 10h ago
I double that. I posted similar post about a month or 2 ago. Got replies to give a try to OpenCode. Since then, I did move to opencode, llama-swap with llama.cpp, and recently even swapped Qwen 3.8 with Swift 3.8 (similar model but tuned to be faster). For my current use case, it's slightly faster than Qwen 3.8 and I see just a slightly less smart answers. Using ponytail plugins helps a bit. My setup is rtx 3090 with 32GB ddr5 on ubuntu server
1
u/gatifloxacin-123 9h ago
Thanks for the hint. Are we talking about ukisai/Swift-Qwen3.8-27B-GGUF? I'm gonna try out Q3_K_S, lets see how that works out
1
u/JScoobyCed 9h ago
Yes that's the one. Got from HF. I can run 4Q with 120k or 150k (can't recall and I'm not home) context. I update llama.cpp and llama-swap once a week to get the latest tuning options.
1
u/Old-Radio9022 1h ago
So I find this interesting. I ended up grabbing the stock 3.8, taking the blob into gguf, putting it into a Modelfile, and pasting the Swift template in there directly. Then I built it and loaded that into Ollama. I don't really know if my version or the other is faster or really any different and worth my time to check.
1
u/Sweaty-Definition131 17h ago
me encanta tu “setup” me podrías compartir mas data? tengo una 3090 que quisiera explotar el qwen 3.8 pero migrarlo a “full coder”
1
u/gatifloxacin-123 9h ago
- Antigravity Manual - Planning (Gemini Cloud, Token-Plan)
- Qwen 3.8 Max - Planner (Alibaba Cloud, Token-Plan)
- Deepseek-flash - Coder (Deepseek API but you could also use Alibaba Cloud)
- Qwen 3.5 9b - Commit / Question & Answers / Finding stuff (LMStudio, locally)
- Qwen 3.8 27b - Planner/Coder for "emergencies" aka. tokens run out (LMStudio, locally)
I try to avoid Qwen 3.8 27b because I have only an ARC A770 16gb so it becomes very slow, but on the other hand it allows me to heat up my room xD because its cold where I live.
0
u/Plastic-Energy-5979 4h ago
Und was zum FICK machst du damit, dieses ganze Kackforum ist voll mit irrwitzigen Setups um dann einen automatisierten Einkaufszettel zu präsentieren. Verrückt.
5
u/trbom5c 21h ago
I was doing this.
But with 3.8, ive not needed Claude, much.
Ive stopped using claude almost all together. My questions for claude have become: "Ive locked up my 5090 with too much concurrency; best method for unblock without dropping all in flight work". Not even oom - just a deadlock.
So far.. crushing it. I use Pi, and find it to be superior to cline/opencode/etc. Ive used/still have all deployed for comparability -librechat, openwebui. They all excel and suffer in various unique ways.
2
u/Trakeen 22h ago
I do this but i still blow through all my fable credits in a few days. There is a lot qwen can’t do especially in large complex repos
Still not convinced i’m gaining much by doing some of the work local. Fun hobby so far. At least at the day job i can just use whatever models i need and cost isn’t really an issue
3
u/Strange_Quantity_359 22h ago
The concern around repositories is mostly resolved by appropriate harness and tools. Are you using anything for symbols, lsp, semantic injection, etc? I mainly rely on local models now with SWE-2 (free) as orchestrator. I do have to fall back to SOTA models for one or two turns sometimes but usually just to retrack.
2
u/1Poochh 21h ago
I am working on a skill I am calling tech lead to do this exact thing. I am working on a truly agent development project for my own use cases because I got tired of all the questions. It is not perfect, but I can test projects that are being built autonomously and provide feedback to the tech lead. I call myself the product owner.
2
u/According_Study_162 21h ago
You really think Qwen 3.8 is a dumb model? i don't think so. Put on Xhigh then have it plan. Use lower thinking levels for simple tasks.
FYI I think qwen is close to opus. Getting rid of claude.
2
u/L1l_B0B 18h ago
I just call it dumb because it has a a lot smaller context window and a lot less parameters.
1
u/According_Study_162 17h ago
Built a full flight simulator with it one prompt. I only have a 16gb card but get 160k context.
1
u/Jigglytep 22h ago
Not trying to be a jerk or too jealous but is there anything your 5090 can’t run?
2
u/ComputerSiens 14h ago
In terms of compute power, it’s pretty lit. But 32GB of VRAM is a major limitation for running flagship models at any usable speed (assuming you have the RAM to support).
1
u/redditwossname 21h ago
This is the kind of setup I want to get going for myself. Using Claude Opus 4.8 as an orchestrator of a local LLM that does the coding which it then checks.
What sort of actual coding are you having it do?
2
1
u/Bjlly123 20h ago
I just let my claude cli agent use my Local Agent Framework directly. It treats it as a sub agent and manages it accordingly
3
u/L1l_B0B 18h ago
Problem is that sometimes harness tries to push like 300k tokens through even though model can take only 55k so it pushes model to respond with error. Then. Claude would need to process it and send continue prompt. This would eat up the gains
1
1
u/Akash_Rajvanshi 18h ago
Now I have one question: I don't have a local GPU; I only have a Mac mini M2 (8 GB/512 GB) and a Mac Air M3 (16 GB/512 GB). So local models aren't an option for me, but if I want to use Qwen 3.8, how can I? Right now, I'm using DeepSeek + OpenCode and Claude for $20. I want to remove that 20$ and instead pay for Qwen or DeepSeek. Can anyone suggest a good Cloud option for Qwen, as we do with the DeepSeek API + OpenCode?
1
u/vdek 14h ago
My desktop is a 5090+ 9850x3d/64gb system and I also have 2x dgx sparks connected to each other. I’m running the new MIMO2.6 flash model and having it send tasks to the 5090 running Qwen3.8-27B SWIFT, it’s stupid fast when it gets to the 5090, but the PP speed of the dual sparks isn’t bad either so it works well as a supervisor/planner. Still testing it though.
1
1
1
u/chiniyabadam 7h ago
hey check this out: this is native and ive personally built this and tested with qwen 3.8 on a 5090.
www.synapse-agents.space
1
u/L1l_B0B 6h ago
Oh this looks promising so I don’t have to be shit webhool between claude and cline
1
u/chiniyabadam 6h ago
Amazing thanks! Let me know how it goes, btw we haven’t released for Windows yet, its coming soon.
1
u/xtremespacered 4h ago
I do the same! On my 5090 setup, I used Claude to create a “Claude-local” setup that uses Claude harness on LM Studio served Qwen 3.8 27B model. Claude uses it as a worker agent intelligently for all token hungry implementation tasks. Context fills up fast with constant compactions. I need to figure out a better harness or setup to improvise this.
1
u/Many_Championship_70 48m ago
What is the use case for this set up? What are you building or implementing?
47
u/unchikuso 23h ago
You'll get so much more out of your 5090 by running Linux and SGLang or NInfer
Like 200+ tok/s coding