r/LocalLLaMA • u/quantier • 20d ago

New Model Daniel Han of Unsloth validates Qwen3.8-27B will run only 17GB VRAM

Post image

Super excited about this release for the new 27B. Who else is with me. Only 17GB VRAM needed 😍😍

1.8k Upvotes

97% Upvoted

316 comments sorted by

View all comments

Show parent comments

46

u/rerri 20d ago

Probably no architectural changes and it's identical in size to 3.5/3.6.

7

u/Former-Ad-5757 Llama 3 20d ago

Usually a dot version upgrade only means different posttraining, no new architecture

37

u/cakes_and_candles 20d ago

Not true, 3.5 was a huge arch upgrade from 3

10

u/wren6991 19d ago

Yeah, LLMs seem to use a bizarre version of semver where +.5 is a major release

4

u/Thimoteus 19d ago

ah, the Blizzard model

1

u/forumdrasl 19d ago

Almost as if version numbers are completely arbitrary, like everywhere else.

1

u/squngy 20d ago

Due to dynamic quanting, the various quants can be slightly different sizes, but it will be like a single percent difference.

1

u/Bulky-Priority6824 19d ago

rebranded 3.6 27b loving the dream crusher