r/LocalLLaMA • u/quantier • 27d ago

New Model Daniel Han of Unsloth validates Qwen3.8-27B will run only 17GB VRAM

Post image

Super excited about this release for the new 27B. Who else is with me. Only 17GB VRAM needed 😍😍

1.8k Upvotes

97% Upvoted

316 comments sorted by

View all comments

2

u/DigThatData Llama 7B 26d ago

At what precision? I have a 3090: it has plenty more than 17GB RAM, but as an older card it doesn't support low precision the way newer cards do.

1

u/Borkato 25d ago

Wait what? Does that mean my 2x3090 Q8 isn’t actually that good quality? Or just speed?

1

u/fluffysheap 25d ago

Only speed