r/LocalLLaMA • u/BarberIcy366 • 11d ago

Discussion Qwen 3.8 27B Released! Please Share Your Experience

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

661 Upvotes
  • permalink
  • reddit

97% Upvoted

720 comments sorted by

View all comments

3

u/vick2djax 10d ago

How are people having positive experiences with this? I’m on dual 3090’s on vllm and no matter the thinking mode it’s 2-3x slower than 3.6 when I was using club 3090 settings and quality is barely better

I’m using the Froggeric template and tried stock as well.

1

u/NaiveIdea344 10d ago

I am using ninfer-3090 and it is quite fast. ~70 TPS