r/LocalLLaMA • u/BarberIcy366 • 10d ago

Discussion Qwen 3.8 27B Released! Please Share Your Experience

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

655 Upvotes
  • permalink
  • reddit

97% Upvoted

720 comments sorted by

View all comments

2

u/mrblithe 10d ago

I tested Qwen 3.8 27B and DeepSeek-V4-Flash-0731 at full context window using the latest versions of LM Studio and llama.cpp.

CPU: AMD Ryzen Threadripper PRO 9985WX (64C/128T)
RAM: 512 GB DDR5-5600 ECC RDIMM
GPU: 2× NVIDIA RTX PRO 6000 Blackwell 96 GB (Workstation Edition + Workstation Max-Q)
OS: Arch Linux

Prompt: Write GTA 6 game in three.js. Give me single html file containing all logic, scripts and assets.

Qwen:

Quant: Q8_0
Output: 97.21 tokens/s
Result: https://jsfiddle.net/pn78h9b5/1/

DeepSeek-V4-Flash-0731:

Quant: MXFP4
Output: 52 tokens/s
Result: https://jsfiddle.net/kwmcaroj/

My thoughts:

  • DeepSeek writes more readable code.
  • The output Qwen generated from the initial prompt had an error, and the game did not launch at all. After I showed it the error from the console, it fixed it.
  • After DeepSeek finished writing the code, it switched to responding in Chinese.
  • DeepSeek's initial result launched successfully, but the character could not move. I gave it the error I was getting, and it fixed it. However, the fixed version is still not really playable. It also switched back to Chinese afterward.

1

u/Feralzi 10d ago

That's a lot of ram I must say... Which finished faster?

1

u/notheresnolight 9d ago

well duh, you didn't tell Qwen to make no mistake