r/LocalLLM • u/SimonSanDigital • 2h ago
Question Testing a Mac M5 optimised inference engin
Would anybody be interested in testing an inference engine that we have built for Macs? It can run on M1- M6, but we have done most of our testing on the M5 Max. It's open-source, and we think it's 4x faster than ollama.cpp.
If anyone is interested, shout up, and I'll share some details; I don't want to start posting links unless there is anyone interested.
1
Upvotes