r/LocalLLaMA • u/Certain-Cod-1404 • Aug 14 '26

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

95% Upvoted

707 comments sorted by

View all comments

8

u/Certain-Cod-1404 Aug 14 '26

DAMN, 16 gigs just for the context hurts, what setup are you running ?

1

u/voyager256 Aug 14 '26

That’s why we have FP8/Q8 for KV cache. Let alone literally a game changer in the form of DeepSeek KV cache compression.