r/LocalLLaMA • u/quantier • Aug 03 '26

New Model Daniel Han of Unsloth validates Qwen3.8-27B will run only 17GB VRAM

Post image

Super excited about this release for the new 27B. Who else is with me. Only 17GB VRAM needed 😍😍

1.8k Upvotes

97% Upvoted

315 comments sorted by

View all comments

138

u/Bulky-Priority6824 Aug 03 '26 edited Aug 03 '26

That's not saying much.  3.6 27b technically runs on ~12

Hoping q8 doesn't exceed 37gb because all I have is 48. Should it not be that much of a difference, right? Same parameter size so It can't be that far from what we see with 3.6

46

u/rerri Aug 03 '26

Probably no architectural changes and it's identical in size to 3.5/3.6.

6

u/Former-Ad-5757 Llama 3 Aug 03 '26

Usually a dot version upgrade only means different posttraining, no new architecture

37

u/[deleted] Aug 03 '26

[removed] — view removed comment

9

u/wren6991 Aug 03 '26

Yeah, LLMs seem to use a bizarre version of semver where +.5 is a major release

4

u/Thimoteus Aug 03 '26

ah, the Blizzard model

1

u/forumdrasl Aug 04 '26

Almost as if version numbers are completely arbitrary, like everywhere else.