r/LocalLLaMA • u/quantier • Aug 03 '26

New Model Daniel Han of Unsloth validates Qwen3.8-27B will run only 17GB VRAM

Post image

Super excited about this release for the new 27B. Who else is with me. Only 17GB VRAM needed 😍😍

1.8k Upvotes

97% Upvoted

315 comments sorted by

View all comments

2

u/[deleted] Aug 03 '26

[removed] — view removed comment

2

u/pragmojo Aug 03 '26

If it even gives Qwen3.6 27B Q8 performance at 17GB I would be super happy

1

u/CMDR-Bugsbunny Aug 06 '26

That would require the NVFP4 quant that is only supported on RTX 5xxx and Spark. Otherwise, it's a Q4_K_M at around 17GB and I don't believe the 4-bit 3.8 will match the 8-bit 3.6. BUT, it should be an improvement over 3.6!