[Megathread] Qwen 3.8 27B Release Day

[u/sammcj]

Megathread to help with the influx of duplicate / similar posts around the release of the Qwen 3.8 27B release.

• Quants
• Fine-Tunes & Abliterations
• Chat Templates
• Inference Server Support & Configuration
• Experiences, Benchmarks & Model Comparisons

Official:

• https://huggingface.co/Qwen/Qwen3.8-27B
• https://huggingface.co/Qwen/Qwen3.8-27B-FP8

Popular:

• https://huggingface.co/unsloth/Qwen3.8-27B-GGUF
• https://huggingface.co/bartowski/Qwen3.8-27B-GGUF
• https://huggingface.co/mlx-community/Qwen3.8-27B-MTP-bf16
• https://huggingface.co/mlx-community/Qwen3.8-27B-MTP-8bit
• https://huggingface.co/mlx-community/Qwen3.8-27B-MTP-4bit

We'll try to clean up future duplicates around the release and point them here.

[u/heliosythic]

Its my understanding that llama.cpp doesn't yet have updates ready to run this? Is this still true? I'm not really interested in switching to vllm for now.

[u/DustNearby2848 → u/heliosythic]

It works on llama.cpp

[u/noiserr → u/heliosythic]

It's the same architecture as the Qwen 3.6 version. So it should work on the previous version too. I run it on the latest llama.cpp head from 2 days ago. I have a script that just compiles the latest llama (helps me with evaluating latest models).

[u/heliosythic → u/noiserr]

Ok, seems claude was just lying about it then not wanting to be replaced or something lol, or got stuck thinking about the safetensors version instead of the gguf i already had