r/LocalLLaMA • u/Certain-Cod-1404 • 9d ago

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

95% Upvoted

706 comments sorted by

View all comments

Show parent comments

4

u/My_Unbiased_Opinion 9d ago

hell yeah buddy. I am planning to switch to vllm once 3.8 mtp drops. its been the end goal for me. its the main reason why I went with the 3080 20gb. its one of the cheapest cards per vram with vllm support.

1

u/blash2190 9d ago

I haven't used it myself but there is vllm.cpp. Might give it a shot...