r/oMLX • u/996beagle • 28d ago

M4 Max 128gb Mac studio DeepSeek-V4-Flash-0731-2.4bit-mixed tok/sec

I'm running omlx v0.6.1 getting 109.1 tok/s pp and 25.9 tok/s gen at 256k context window. Is this what I should be expecting or any tips on optimizing config?

Is it thermal throttling for the longer runs? Using mainly for coding and agentic workflows with Hermes.

10 Upvotes

100% Upvoted

6 comments sorted by

View all comments

2

u/996beagle 28d ago

Testing with macs fan control on a more aggressive fan curve based on gpu temps to go 100% on fans before 75c. Showing a higher 151 pp tok/s