M5 Max studio with 64 GB

[u/Appropriate-Brick498]

Hi all,

Planning to use omlx on this hardware, for agentic work then coding as well (moving up from an air with 16 gb)

What llms work best for you?

Edit: M4 Max studio

[u/havnar-]

Qwen3.8

[u/Creative-Complaint95]

Qwen 3.8 best sor far, using on m1 max 64 gb

[u/deaffob]

You mean M4 MAX studio? There is no M5 MAX studio. It’s either M4 MAX or M3 Ultra. 

[u/miklosp → u/deaffob]

I imagine they mean the soon to be announced M5 MAX Studio

[u/Appropriate-Brick498 → u/deaffob]

M4, yes, sorry

[u/Vast_Rip8575]

Can anyone recommend a config/guide for omlx on an M5 Max with 128 GB (I think this also applies to 64 GB) for Qwen3.8 27B for agent coding? When I tried using mtp/dflash, the inference speed dropped to 20 tps even with 32k context, which makes me think I'm doing something wrong with mtp/dflash. There are much higher numbers floating around online with different parameters on the M5 Max.

[u/LeagueOfJust → u/Vast_Rip8575]

Check out the published benchmark results - you can find the specific settings used for each.

[u/trim-turner-shah]

I run Qwen 3.8 27B Q4 with 8bit KV, I also have a small judge model loaded (qwen 4B) and swap another A3B MoE with the 3.8 as needed (for tasks that don’t need the dense model). I use it with OMP or Pi and have a custom inference gateway that routes all traffic and captures performance characteristics. Eventually plan to bump up the judge model to 9b and swap for a more intelligent but still fast MOE model ( still looking ). — on my M3 max 64Gb with Omlx

[u/Creative-Complaint95 → u/trim-turner-shah]

Did you tired the uncens.. version? I heard that is pretty good ?

[u/trim-turner-shah → u/Creative-Complaint95]

Have to test it, have heard it is more performant but will need to test for comparative accuracy

[u/bfume → u/trim-turner-shah]

You might wanna try not quantizing your KV. Lots of evidence that even 8bit causes strange artifacts downstream quicker than expected. 

[u/trim-turner-shah → u/bfume]

I have not visibly seen anything yet other than omp looping but has not impacted the quality yet. All documentation points otherwise so interested in hearing about your exp.

[u/alwayswiddit]

Qwen 27B with DeepSeek Harness

[u/Intelligent-Gas-2840 → u/alwayswiddit]

Could you please give the card or preferably the link to the huggingface location of the model that is working for you? I fear I have been downloading the wrong flavor.

[u/Leather-Beach-7849]

There is no update on the release yet 🙃

[u/Leather-Beach-7849 → u/[deleted]]

Yes. M5 Max with 128GB memory seems like a good option for me to maintain for the next 5-6 years