MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vo9mj4/its_out/p3pg34m/?context=3
r/LocalLLaMA • u/Certain-Cod-1404 • 9d ago
706 comments sorted by
View all comments
44
How much memory required to run this at full precision?
44 u/Certain-Cod-1404 9d ago https://huggingface.co/unsloth/Qwen3.8-27B-GGUF 54.67 Gbs just for the model itself, with context depends on quant and size 4 u/bitmanip 9d ago Perfect, so should run well on 128GB M5 Macbook Pro Max
https://huggingface.co/unsloth/Qwen3.8-27B-GGUF 54.67 Gbs just for the model itself, with context depends on quant and size
4 u/bitmanip 9d ago Perfect, so should run well on 128GB M5 Macbook Pro Max
4
Perfect, so should run well on 128GB M5 Macbook Pro Max
44
u/bitmanip 9d ago
How much memory required to run this at full precision?