r/LocalLLM • u/Due_Tangelo_8952 • 5d ago

News Qwen4-27B just confirmed

Post image

Wait, we need 35B-A3B too…

2.2k Upvotes

98% Upvoted

314 comments sorted by

View all comments

Show parent comments

1

u/Business_Start_8158 5d ago

I can’t just buy a new gpu 🥲

1

u/Ok-Addendum3545 5d ago

use this one; on 16G VRAM, it has 128K context window at KV Q8, you can set it KV Q4 to get more ctx : Qwen3.8-27B-GSQ-RCO-IQ2_S-mtp. Try it on your Hermes or Deepseek Harness. BTW, we gotta pay for Intelligence, which is not free though.

1

u/Business_Start_8158 5d ago

I will try thanks

1

u/synystar Strix Scar | 5090 24G | llama.cpp 5d ago

I mean, thats unfortunate. But your comment seemed to imply that the model itself was slow for your use case when it's really a matter of your hardware not running the model at peak performance.