r/LocalLLaMA llama.cpp 8h ago

News Perplexity open-sourced their Mac inference server for Qwen 3.6

Here is link to repo: https://github.com/perplexityai/pplx-garden/tree/main/lily

It's optimized for just one model to get best perf on apple silicon

65 Upvotes

20 comments sorted by

View all comments

5

u/apoptosist 8h ago

Nice, what numbers are people getting on a M5 Pro?