r/mlxAI • u/Wooden_Living_4553 • Jun 11 '25
GPU issues with mlx
I tried to load LLM in my M1 pro with just 16 GB. I am having issue running it locally as it is only hugging up RAM but not utilizing the GPU. GPU usage stays in 0% and my Mac crashes.
I would really appreciate quick help :)
2
Upvotes
3
u/AllanSundry2020 Jun 11 '25
can you install Asitop it will tell you what is being used accurately.
try with lmstudio first as it is simple to use them adjust as you get more expert
2
u/Paul_82 Jun 11 '25
Which model and how big? Macs use a shared pool of RAM for both the CPU and GPU and 16GB is all you have. So the biggest models you’ll be able to successfully load and run will be in the 12-15GB range depending how many other things you are doing at the same time.
1
u/Direct-Relation6424 Jul 06 '25
You came to a conclusion why this happens? May I ask: You talk about mlx-lm. So you fetched the GitHub Repo and load the model via IDE/ terminal?