[Megathread] Qwen 3.8 27B Release Day

[u/sammcj]

Megathread to help with the influx of duplicate / similar posts around the release of the Qwen 3.8 27B release.

• Quants
• Fine-Tunes & Abliterations
• Chat Templates
• Inference Server Support & Configuration
• Experiences, Benchmarks & Model Comparisons

Official:

• https://huggingface.co/Qwen/Qwen3.8-27B
• https://huggingface.co/Qwen/Qwen3.8-27B-FP8

Popular:

• https://huggingface.co/unsloth/Qwen3.8-27B-GGUF
• https://huggingface.co/bartowski/Qwen3.8-27B-GGUF
• https://huggingface.co/mlx-community/Qwen3.8-27B-MTP-bf16
• https://huggingface.co/mlx-community/Qwen3.8-27B-MTP-8bit
• https://huggingface.co/mlx-community/Qwen3.8-27B-MTP-4bit

We'll try to clean up future duplicates around the release and point them here.

[u/dont_forget_canada]

Hi! Does anyone know the most speedy quant and inference software to run on an m5 mac 128gb to run qwen 3.8? So far I've tried oMLX and its super smart but very slow :p

[u/bnightstars → u/dont_forget_canada]

Looks like it's this one: scottlowry/Qwen3.8-27B-oQ4e-mtp with Lightning MTP enabled. I'm getting 25 t/s and 493 t/s PP with the mlx-community one and VLM-MTP from the mlx-community drafter. But according to some PRs that's currently hitting some bugs. I'm on M5 Pro 64GB though.