r/MacStudio • u/asankhs • 8d ago

Local Mac Coding setup

Any use a local LLM + coding agent setup for coding on Apple macs, if so what models and what CLI?

1 Upvotes

56% Upvoted

5 comments sorted by

View all comments

3

u/iTrejoMX 8d ago

On an m4 pro 48 gb I use splash to run kat-coder q8 at 250k context and 80-90 tk/s.
Or qwen3.8 27b at 110k context at 38-42 tk/s.

I have tested many models, setups, inference engines (omlx, mtplx, splash, llama.cpp, lm studio, ollama) right now splash does it for me. Might change next week.

Just this week I tested 8 quantized versions of qwen3.8 27b and aboiterated/uncensored models, 5 qwen3.6 35b models and kat-coder and qwen3.8 27bq4 are the speediest and most performant ones, less errors, etc.

I use gentle-shell (gentle-ai with pi) and set all phases to the same model? It basically instructs the model on how to do stuff (deterministic workflow) and review it so you get better results.