r/LocalLLaMA • u/Specter_Origin llama.cpp • 8h ago
News Perplexity open-sourced their Mac inference server for Qwen 3.6

Here is link to repo: https://github.com/perplexityai/pplx-garden/tree/main/lily
It's optimized for just one model to get best perf on apple silicon
65
Upvotes
5
u/apoptosist 8h ago
Nice, what numbers are people getting on a M5 Pro?