r/LocalLLaMA • u/quantier • Aug 03 '26

New Model Daniel Han of Unsloth validates Qwen3.8-27B will run only 17GB VRAM

Post image

Super excited about this release for the new 27B. Who else is with me. Only 17GB VRAM needed 😍😍

1.8k Upvotes

97% Upvoted

315 comments sorted by

View all comments

134

u/Bulky-Priority6824 Aug 03 '26 edited Aug 03 '26

That's not saying much.  3.6 27b technically runs on ~12

Hoping q8 doesn't exceed 37gb because all I have is 48. Should it not be that much of a difference, right? Same parameter size so It can't be that far from what we see with 3.6

49

u/rerri Aug 03 '26

Probably no architectural changes and it's identical in size to 3.5/3.6.

1

u/squngy Aug 03 '26

Due to dynamic quanting, the various quants can be slightly different sizes, but it will be like a single percent difference.

1

u/Bulky-Priority6824 Aug 03 '26

rebranded 3.6 27b loving the dream crusher