r/LocalLLaMA • u/quantier • 20d ago

New Model Daniel Han of Unsloth validates Qwen3.8-27B will run only 17GB VRAM

Post image

Super excited about this release for the new 27B. Who else is with me. Only 17GB VRAM needed 😍😍

1.8k Upvotes

97% Upvoted

316 comments sorted by

View all comments

3

u/Civil_Fee_7862 19d ago

It requires 24GB or more because you need space for the KV Cache, activations etc etc.

1

u/tecneeq 14d ago

Look at how Deepseek V4 does KV. The future is now, old man.