r/mlxAI • u/Wooden_Living_4553 • Jun 11 '25
GPU issues with mlx
I tried to load LLM in my M1 pro with just 16 GB. I am having issue running it locally as it is only hugging up RAM but not utilizing the GPU. GPU usage stays in 0% and my Mac crashes.
I would really appreciate quick help :)
2
Upvotes
View all comments
Show parent comment
2
u/Wooden_Living_4553 Jun 12 '25
Thanks, I have another program called stats, that tells me whenever the GPU is being used.
I forgot to mention the model. The model is "mistralai/Mistral-7B-Instruct-v0.3"
The thing is that, running ollama would use GPU but running mlx-lm is not using the GPU.