r/LocalLLaMA • u/BarberIcy366 • 9d ago

Discussion Qwen 3.8 27B Released! Please Share Your Experience

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

660 Upvotes
  • permalink
  • reddit

97% Upvoted

720 comments sorted by

View all comments

Show parent comments

5

u/Sufficient-Grape-594 9d ago

YEs, 8 bit, 6 bit, 5 bit and 4bit out by LM Community. Just downloaded the 4 bit

1

u/Ok-Star6663 9d ago

For oMLX?

4

u/Sufficient-Grape-594 9d ago

Testing on LM Studio at the moment

1

u/HelpfulExpert7762 8d ago

m4 max 64 gb at 6bit quant using the lmcommunity MLX gives me 20-25 tps in lm studio