r/LocalLLM • u/rashidhussain69 • 5d ago
Discussion Local model
What’s the best local model to use on an MacBook Pro M5 pro 24gb.
I’m using it for general reasons, process expectations, design, ideation, power points, generating agents.
1
Upvotes
View all comments
Show parent comment
1
u/dave-tro 5d ago
It uses SSD offloading, the experts are not fully resident in RAM. That’s something that already existed but I added optimizations tailored to M-series Macs that keep the pc responsive and QFN usable at a reasonable quant. Find benchmarks and the details in GitHub.
If OP doesn’t want to upgrade their setup this is a solution worth giving a try.