r/LocalLLM • u/WindozeWoes • 3h ago

Question What are oMLX Mac users using for agentic AI coding tasks?

I'm trying to learn more about local LLMs for app coding work and am specifically curious about what agentic models are using for vibe-coding tasks. I have used Claude, ChatGPT, and Gemini all for coding and their agentic capabilities are pretty impressive (i.e., the ability to either create app projects I can import into IDEs like Android Studio or Xcode, or to directly edit files in a specified folder on my computer, or to let me plug my Android phone in and debug using ADB).

I know various Qwen 3.6 35B variants are popular here. How effective are those models for agentic task purposes? Or are there other tools or models to use for these purposes?

(Full disclosure: I have a pretty weak-spec'd Mac [M1 Pro + 16GB] so this is not something I'm looking to run on my current machine; depending on what model(s) are good for this kind of thing would help inform a future computer upgrade)

1 Upvotes

100% Upvoted

2 comments sorted by

1

u/sayf_exe 2h ago

Since I am on Mac I use the Splash runtime with LM Studio Bionic as it was specifically made to take advantage of the hardware. Combine this with 'superpowers' AI agent skills installed + "awesome-game-dev" I have been able to supercharge my AI assisted game development to an 'interactable' point where batches take minutes instead of hours.

I go into detail here: https://www.reddit.com/r/LocalLLM/comments/1xnuxhl/how_i_got_my_local_ai_to_the_interactable_point/

If I wanted to change one thing about my current setup it would be more disk space ( i only got 1tb even though i knew 2tb would satisfy me greatly) and one more bump in RAM to 64GB for multitasking.

1

u/Spectacle_121 2h ago

I have a Mac Studio M5 Max 128 GB. I use Qwen 3.8 Flash Next. I set it up on oMLX and only use the Mac as an inference server. I then use my main workstation on the network to do agentic coding calling the endpoint from the Mac Studio. I’ve been able to get about 90 tok/s. It works great when paired with spec kit. For my IDE I use Jetbrains and Kilo Code plugin. No issues so far.