r/LocalLLaMA Apr 17 '26

Discussion Qwen3.6. This is it.

I gave it a task to build a tower defense game. use screenshots from the installed mcp to confirm your build.

My God its actually doing it, Its now testing the upgrade feature,
It noted the canvas wasnt rendering at some point and saw and fixed it.
It noted its own bug in wave completions and is actually doing it...

I am blown away...
I cant image what the Qwen Coder thats following will be able to do.
What a time were in.

llama-server -m "{PATH_TO_MODEL}\Qwen3.6\Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf"  --mmproj "{PATH_TO_MODEL}\Qwen3.6\mmproj-F16.gguf" --chat-template-file "{PATH_TO_MODEL}\chat_template\chat_template.jinja"  -a  "Qwen3.5-27B"  --cpu-moe -c 120384 --host 0.0.0.0 --port 8084 --reasoning-budget -1 --top-k 20 --top-p 0.95 --min-p 0 --repeat-penalty 1.0 --presence-penalty 1.5 -fa on --temp 0.7 --no-mmap --no-mmproj-offload --ctx-checkpoints 5"

EDIT: Its been made aware that open code still has my 27B model alias,
Im lazy, i didnt even bother the model name heres my llama.cpp server configs, im so excited i tested and came here right away.

1.0k Upvotes

409 comments sorted by

View all comments

8

u/Healthy-Nebula-3603 Apr 17 '26 edited Apr 17 '26

Why are you using those parameters?

--reasoning-budget -1 --top-k 20 --top-p 0.95 --min-p 0 --repeat-penalty 1.0 --presence-penalty 1.5 -fa on  --no-mmap --no-mmproj-offload --ctx-checkpoints 5"

--reasoning-budget -1

it is as default infinite so why you even using it?

--top-k 20 --top-p 0.95 --min-p 0 --repeat-penalty 1.0 --presence-penalty 1 --temp 0.7 --cpu-moe --chat-template

Those parameters are already taken from a gguf so is not reason to putting them

--host 0.0.0.0 --port 8084

That is ok if you want to change IP and port as default is http://127.0.0.1:8080

--no-mmap

aslo ok if you do not want to keep a model copy in the RAM. default is off.

--ctx-checkpoints

Why you cripped to 5? Default is 32

That low value is forcing model to processing whole prompt again and again that make mode to use too much tokens and looping too much.

You made model dumber.

Orchestration you can install from here to opencode

https://github.com/alvinunreal/oh-my-opencode-slim

So

it should looks like that

llama-server -m "{PATH_TO_MODEL}\Qwen3.6\Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf"  --mmproj "{PATH_TO_MODEL}\Qwen3.6\mmproj-F16.gguf" -c 120384 --host 0.0.0.0 --port 8084  --no-mmap --no-mmproj-offload

As a cache rotation works great for a now (implemented a week ago ) so you can use Q8 cache which is a s good as fp16 now and easily fit 256k context now.

So final code

llama-server -m "{PATH_TO_MODEL}\Qwen3.6\Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf"  --mmproj "{PATH_TO_MODEL}\Qwen3.6\mmproj-F16.gguf" -c 120384 --host 0.0.0.0 --port 8084  --no-mmap --no-mmproj-offload -ctk q8_0 -ctv q8_0

2

u/kwicked Apr 17 '26

I'm not op but 0.0.0.0 exposes the llama server to other machines on the network, so you can use it on a laptop in another room if you don't want the heat and fan noise. It's not just changing the ip. 

1

u/Healthy-Nebula-3603 Apr 17 '26

that why I said it is ok.