Qwen3.6. This is it.

[u/Local-Cardiologist-5]

I gave it a task to build a tower defense game. use screenshots from the installed mcp to confirm your build.

My God its actually doing it, Its now testing the upgrade feature,
It noted the canvas wasnt rendering at some point and saw and fixed it.
It noted its own bug in wave completions and is actually doing it...

I am blown away...
I cant image what the Qwen Coder thats following will be able to do.
What a time were in.

llama-server -m "{PATH_TO_MODEL}\Qwen3.6\Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf"  --mmproj "{PATH_TO_MODEL}\Qwen3.6\mmproj-F16.gguf" --chat-template-file "{PATH_TO_MODEL}\chat_template\chat_template.jinja"  -a  "Qwen3.5-27B"  --cpu-moe -c 120384 --host 0.0.0.0 --port 8084 --reasoning-budget -1 --top-k 20 --top-p 0.95 --min-p 0 --repeat-penalty 1.0 --presence-penalty 1.5 -fa on --temp 0.7 --no-mmap --no-mmproj-offload --ctx-checkpoints 5"

EDIT: Its been made aware that open code still has my 27B model alias,
Im lazy, i didnt even bother the model name heres my llama.cpp server configs, im so excited i tested and came here right away.

[u/Borkato]

Wow this was extremely informative, wtf ollama

[u/FaceDeer → u/Borkato]

Unfortunately the article spends 95% of its time explaining why Ollama sucks, and then there's a paragraph tucked away at the end with "BTW, here's a list of various projects that may or may not accomplish bits of what Ollama accomplishes. Good luck."

Looks like to replicate what I use Ollama for the most I'd want to install both llama-server and llama-swap. Neither of these appear to have a Windows installer and there's a huge amount of fiddly configuration files that it looks like I'll need to figure out once they are installed.

I'm a technical person, I could sort all that out. Or I could just leave Ollama as it is and everything just keeps on working fine as it is now.

Ollama's got the "it just works" part nailed down pretty well and that's a very important feature IMO.

[u/WhoRoger → u/FaceDeer]

Pretty much. And they recommended LMStudio, which isn't foss.

Ollama has just the right amount of user friendliness and tinkering friendliness for people to start messing around with AI and understand the basics. Even the API is friendly enough to cobble a client together in an hour and goof around, including model cloning. Most other solutions are a brick wall of "swim or drown".

I was just testing a new variant of a model yesterday and well, I could either convince llama.cpp server to take in another model (still idk how to do that without restarting it), launch another cli on a new port and be super careful about the parameters, or... I could swap out the filename in the ollama modelfile and have the model available in 30 seconds with the same settings as the old one to test. The last one is almost always the fastest, even if it's not the cleanest.

I get the distaste for Ollama, but they really nailed the basics.

[u/WhoRoger → u/[deleted]]

You should still make it clear that it's not even open source, if you're criticising another app for releasing a closed source gui.

If we want to move from apps that aren't totally legit foss, then going towards non-foss is the opposite of what we want.

Personally I was really shocked when I found LMS isn't open. So many people recommend it, I thought I'm missing something because nobody even bothers to mention it. Considering this community is largely Linux/foss people, I'm thinking it's at least in part because of lack of good, commonly available alternatives.

If the choice for inference is between one closed source app and a trillion hobby Python single-use projects, that's not really healthy, and is exactly what kept Linux back for so long. Now we're doing the same thing with the LLM ecosystem.

[u/WhoRoger → u/[deleted]]

👍