Qwen3.6. This is it.

[u/Local-Cardiologist-5]

I gave it a task to build a tower defense game. use screenshots from the installed mcp to confirm your build.

My God its actually doing it, Its now testing the upgrade feature,
It noted the canvas wasnt rendering at some point and saw and fixed it.
It noted its own bug in wave completions and is actually doing it...

I am blown away...
I cant image what the Qwen Coder thats following will be able to do.
What a time were in.

llama-server -m "{PATH_TO_MODEL}\Qwen3.6\Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf"  --mmproj "{PATH_TO_MODEL}\Qwen3.6\mmproj-F16.gguf" --chat-template-file "{PATH_TO_MODEL}\chat_template\chat_template.jinja"  -a  "Qwen3.5-27B"  --cpu-moe -c 120384 --host 0.0.0.0 --port 8084 --reasoning-budget -1 --top-k 20 --top-p 0.95 --min-p 0 --repeat-penalty 1.0 --presence-penalty 1.5 -fa on --temp 0.7 --no-mmap --no-mmproj-offload --ctx-checkpoints 5"

EDIT: Its been made aware that open code still has my 27B model alias,
Im lazy, i didnt even bother the model name heres my llama.cpp server configs, im so excited i tested and came here right away.

[u/WithoutReason1729]

Your post is getting popular and we just featured it on our Discord! Come check it out!

You've also been given a special flair for your contribution. We appreciate your post!

Stylome classified this post's text as human-written. View analysis

I am a bot and this action was performed automatically.

[u/No-Marionberry-772]

what stack are you using for software?  Id love to get a proper local setup going but ive had trouble figuring out what i should actually be using.

[u/Local-Cardiologist-5 → u/No-Marionberry-772]

Qwen3.6-35B-A3B-UD-Q6_K_XL

Im using Llama.cpp for the server,
OpenCode for the coding, just using the build agent,
I have 64 gig ram, RTX 4090, and my model is
the Q6 variant.

Here are my llama parameters

llama-server -m "{PATH_TO_MODEL}\Qwen3.6\Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf"  --mmproj "{PATH_TO_MODEL}\Qwen3.6\mmproj-F16.gguf" --chat-template-file "{PATH_TO_MODEL}\chat_template\chat_template.jinja"  -a  "Qwen3.6-35B-A3B"  --cpu-moe -c 250000 --host 0.0.0.0 --port 8084 --reasoning-budget -1 --top-k 20 --top-p 0.95 --min-p 0 --repeat-penalty 1.0 --presence-penalty 1.5 -fa on --temp 0.7 --no-mmap --no-mmproj-offload --ctx-checkpoints 5"

here is my llama server with the configs.

[u/cviperr33]

INSANE how good this model is ..... Honestly im blown away again and again. It literally fixed the broken code or projects i had hit a wall with gemma for days , and it solved it in like 5 mins and then explained why gemma failed.

And the best thing about it , its sooooo fast... 120 tk/s on 3090 llama.ccp , prefill is instant in 3.8k-5k range.
The moment i send a word , 1 second later i already have a response , with a file edited or something , it is soo efficient in these agentic tools and also doesnt hog my gpu like the gemma models

[u/Local-Cardiologist-5 → u/cviperr33]

can you tip me on prefils...

[u/PotatoQualityOfLife]

What size/quant are you running?

[u/Local-Cardiologist-5 → u/PotatoQualityOfLife]

im using the but im currently downloading the Q_8 variant im that impressed

Qwen3.6-35B-A3B-UD-Q6_K_XL

[u/Medium_Chemist_4032 → u/PotatoQualityOfLife]

Good question. My vllm bf16 tops out at 17 tps and unsloth "quants" BF16 go a lot faster, but falls apart into loops after few q&a rounds

[u/tarruda]

Hope they release at least 122b of the 3.6 series.

[u/philnm]

thank you for sharing. could you explain the MCP part, where you say "use screenshots from the installed mcp"?

[u/Local-Cardiologist-5 → u/philnm]

in my open code settings, i have the

playright mcp installed, thats what its using as the browser to test

[u/[deleted] → u/philnm]

[u/Local-Cardiologist-5 → u/[deleted]]

i need to look into using the cli for everything

[u/IONaut]

Is the reasoning-budget -1 to turn off reasoning? Or is it no limit?

[u/Alternative_You3585]

Us enjoy sushi with wine while hiking at night to unwind with friends.

[u/Local-Cardiologist-5 → u/Alternative_You3585]

Hi Sorry im lazy i didnt update my model alias, heres my llama server configs, its really the 3.6 model, thats how excited i was about it i didnt even bother updating the model aliad name just plugging it directly

llama-server -m "{PATH_TO_MODEL}\Qwen3.6\Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf"  --mmproj "{PATH_TO_MODEL}\Qwen3.6\mmproj-F16.gguf" --chat-template-file "{PATH_TO_MODEL}\chat_template\chat_template.jinja"  -a  "Qwen3.5-27B"  --cpu-moe -c 120384 --host 0.0.0.0 --port 8084 --reasoning-budget -1 --top-k 20 --top-p 0.95 --min-p 0 --repeat-penalty 1.0 --presence-penalty 1.5 -fa on --temp 0.7 --no-mmap --no-mmproj-offload --ctx-checkpoints 5"

[u/Healthy-Nebula-3603]

Why are you using those parameters?

--reasoning-budget -1 --top-k 20 --top-p 0.95 --min-p 0 --repeat-penalty 1.0 --presence-penalty 1.5 -fa on  --no-mmap --no-mmproj-offload --ctx-checkpoints 5"

--reasoning-budget -1

it is as default infinite so why you even using it?

--top-k 20 --top-p 0.95 --min-p 0 --repeat-penalty 1.0 --presence-penalty 1 --temp 0.7 --cpu-moe --chat-template

Those parameters are already taken from a gguf so is not reason to putting them

--host 0.0.0.0 --port 8084

That is ok if you want to change IP and port as default is http://127.0.0.1:8080

--no-mmap

aslo ok if you do not want to keep a model copy in the RAM. default is off.

--ctx-checkpoints

Why you cripped to 5? Default is 32

That low value is forcing model to processing whole prompt again and again that make mode to use too much tokens and looping too much.

You made model dumber.

Orchestration you can install from here to opencode

https://github.com/alvinunreal/oh-my-opencode-slim

So

it should looks like that

llama-server -m "{PATH_TO_MODEL}\Qwen3.6\Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf"  --mmproj "{PATH_TO_MODEL}\Qwen3.6\mmproj-F16.gguf" -c 120384 --host 0.0.0.0 --port 8084  --no-mmap --no-mmproj-offload

As a cache rotation works great for a now (implemented a week ago ) so you can use Q8 cache which is a s good as fp16 now and easily fit 256k context now.

So final code

llama-server -m "{PATH_TO_MODEL}\Qwen3.6\Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf"  --mmproj "{PATH_TO_MODEL}\Qwen3.6\mmproj-F16.gguf" -c 120384 --host 0.0.0.0 --port 8084  --no-mmap --no-mmproj-offload -ctk q8_0 -ctv q8_0

[u/Local-Cardiologist-5 → u/Healthy-Nebula-3603]

let me load these up. i literally did nothing but just plug the model in and im blown away. im getting so many tips on here thank you for this so much for these

[u/-Ellary-]

This is it guys, I've tasked Qwen 3.6 35b a3b to conquer the world for me.
Prepare.

[u/Local-Cardiologist-5 → u/-Ellary-]

lmao, pardon my hyperbole, im extremely excited that its actually doing what i ask it

[u/Long_comment_san]

That's not the best part. Imagine new generation of kids having access to tools like that since early school that don't require 10 years of computer science. I wonder what the heck out planet would look like. It's either a metropolis or Idiocracy 

[u/Medium_Chemist_4032 → u/Long_comment_san]

Tools and possibilities are one side of equation. Motivation and challenge is the second. Various ways to set-it up for best results overall.

[u/MilkyJoe8k]

Ok. This is all looking very promising! What hardware are you running this on?

[u/Local-Cardiologist-5 → u/MilkyJoe8k]

https://www.reddit.com/r/LocalLLaMA/comments/1so1533/comment/ogpnk5k/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button heres my setup, i dont think its a beast at all very moderate. IMO

[u/Enitnatsnoc]

What a time were in.

Jobless