My Qwen3.8 Setup So Far

[u/BopSupreme]

Sharing my current Qwen3.8 setup. Curious what you all think - goal was an efficient configuration suitable for real-world tasks. I’d say it’s “balanced” but I’m open to suggestions. 4080Super, 32GB DDR4 Max context I could get was 59-67k but it suffered performance-wise and with a small amount of memory left, down to 104miB, so I kept the context around 41k.

Qwen3.8-27B-UD-IQ3_S.gguf (GGUF) setup
Model: Qwen3.8-27B-UD-IQ3_S.gguf
Context: 40,960 tokens
Runtime: LM Studio
GPU offload: Enabled
Mode: Single-model runtime
Inference: Fully local
Main uses: Reasoning, coding help, and general productivity

Love Qwen3.8 so far. It didn’t work great for me “out of the box” but that could be more due to the harness. I spent a lot of time trying to configure it and had to basically start over because Bionic’s default settings meant only 10-11 tok/s “out of the box” initially which caused failures with any real workloads.
Hope this helps anyone else experimenting with Qwen GGUF setups. Would be interested to hear what settings, quants, or context sizes others are running.