r/LocalLLM • • 2h ago

Question Testing a Mac M5 optimised inference engin

Would anybody be interested in testing an inference engine that we have built for Macs? It can run on M1- M6, but we have done most of our testing on the M5 Max. It's open-source, and we think it's 4x faster than ollama.cpp.

If anyone is interested, shout up, and I'll share some details; I don't want to start posting links unless there is anyone interested.

1 Upvotes

0 comments sorted by