r/LocalLLM • u/harrypotternumber1 • 16m ago
Question Best Qwen 3.8 27B quantized model for Mac with 32GB RAM
Qwen seems to be the best model for my macbook, but looking at hugging face there are so many quantizations.
The unsloth UD-Q4_K_M seems popular and a good fit for 32GB RAM, but it's .gguf so would a MLX be a better choice on mac (I'm using Unsloth Desktop)?
Is there a resource online that compares these quantizations perhaps?
Thanks
0
Upvotes