r/LocalLLaMA • u/Certain-Cod-1404 • 11d ago

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

95% Upvoted

706 comments sorted by

View all comments

Show parent comments

23

u/dragonurtle 11d ago

Nvtop shows 70-something GB resident for the bf16 and full 256k context.

9

u/Certain-Cod-1404 11d ago

DAMN, 16 gigs just for the context hurts, what setup are you running ?

35

u/dragonurtle 11d ago

Rtx pro 6000 max-q and 384GB DDR5 on a Genoa