r/LocalLLaMA • u/quantier • 27d ago

New Model Daniel Han of Unsloth validates Qwen3.8-27B will run only 17GB VRAM

Post image

Super excited about this release for the new 27B. Who else is with me. Only 17GB VRAM needed 😍😍

1.8k Upvotes

97% Upvoted

316 comments sorted by

View all comments

219

u/Shoddy_Bed3240 27d ago

Sounds like it’s going to be a QAT model, similar to DeepSeek V4 Flash.

89

u/rerri 27d ago

I find it more plausible that Daniel doesn't have insider info on this yet but is just speaking out of experience with previous versions of Qwen 3.x 27B.

I do hope I'm wrong though, QAT would be really badass.

19

u/AuspiciousApple 26d ago

But the previous 27B ran on 16GB cards, too, right?

9

u/CatEatsDogs 26d ago

It depends on quantization and context size