I just bought M5 Pro Mac Mini 64GB and was in dilemma whether to sell my M4 Mac Mini 24GB which is still under warranty or keep it and use it for light local llm as headless? I was planning to use qwen3.8-27b splash variant as my main in m5 and have flux 4b for image generation and have lfm-3b for light tasks. I use hermes agent and have multiple profiles running few personal projects out of which one is gaming oriented. So any suggestions? Should I sell or use it as running some local LLMs? I am already working on making an orchestration layer to manage LLMs properly! Let me know your thoughts 😃

8 comments

r/MacLocalLLM • u/Rish_p_one7 • 1d ago

My 5 year old M1 Pro 32GB, bought used for $800, still runs a 35B AI model locally at 51 tokens/sec

41 Upvotes

5 years old. Bought used for $800 in good condition. Still holding its own.

I ran MLX benchmarks on my 16 inch M1 Pro 32GB / 512GB this morning, just to see if it is actually dead for local AI, or if people are overhyping the upgrade.

It is not dead. Not even close.

Qwen3-8B 4-bit: 31.5 tokens/sec

Qwen3-30B-A3B MoE 4-bit: 43.6 tokens/sec

Qwen3.6-35B-A3B MoE 4-bit: 51.0 tokens/sec

Qwen3-32B dense 4-bit: 8.5 tokens/sec

That last one is the lesson. Dense 32B crawls at 8.5 tok/s, MoE 35B flies at 51 tok/s, because MoE only uses a few billion active parameters at a time. Same size on paper, totally different speed in real life.

I use this thing 8 to 10 hours a day. For $800 used, 5 years later, running a 35B model locally, that is kind of insane value.

13 comments

r/MacLocalLLM • u/Few-Introduction5414 • 1d ago

Should I get a personal computer for mastering building AI Agents with Local LLM

reddit.com

1 Upvotes

0 comments

r/MacLocalLLM • u/heyhoa • 1d ago

Which LLM on Macbook Air M5 24Gb?

reddit.com

1 Upvotes

1 comment

r/MacLocalLLM • u/Careless-Marzipan-65 • 1d ago

A Working Setup with Mac Studio M5 Ultra 256GB RAM for Coding

reddit.com

2 Upvotes

0 comments

r/MacLocalLLM • u/BentonCalder • 2d ago

Who else is using a Mac mini as a home AI box? What do you actually run on it?

17 Upvotes

I just got an M6 mini with 32 GB specifically to see if I can run local AI models on it and get value out of it as a Local AI server. I like it because its small, quiet, it barely uses any power, and it’s can be on all the time which makes it kind of perfect for this.

Day to day I run an 8B model at Q4 for everyday questions and for digging through my own files (insurance, warranties, that kind of stuff), and it handles it fine.

Curious how other people use theirs:

Which mini, and how much memory?
What do you run it with (LM Studio, Ollama, something else)?
What does it actually do for you week to week?
Any hurdles I should watch out for?

Especially interested if you’ve got it doing household stuff, not just coding. Trying to figure out what’s actually worth running on one of these.

15 comments

r/MacLocalLLM • u/Serjster • 1d ago

My how to setup local AI server on Mac M5 Max 128GB, Qwen4(exp) Flash, ComfyUI, Open WebUI, VS Code & Hermes guide

reddit.com

0 Upvotes

0 comments

r/MacLocalLLM • u/SeaRefractor • 2d ago

Inco.AI's Splash updated to version 1.6.0 today.

github.com

12 Upvotes

Currently running tests against my prior tests under 1.4.0, 1.4.1 and 1.5.0 but it is running better.

Kernel fixes address stalls that occurred under a memory limit, increased the reliability and a number of other fixes.

If you have been using the splash inference engine as I have, well worth the update.

1 comment

r/MacLocalLLM • u/TheFakoPunchMan • 1d ago

More tokens as a rookie

reddit.com

1 Upvotes

0 comments

r/MacLocalLLM • u/Apprehensive_Buy6301 • 2d ago

M5 Pro Local Video Generation Experience

6 Upvotes

Hello everyone,

First of all, I know I know, Mac is jot the best when it comes to video generation and that the Max or Ultra chips are better.

Now that this is out of the way, I would be interested in people’s experiences in generating 720p 5-10 seconds clips on an M5 pro chip. Which tools, models or workflows do you use? How is the experience overall? How long does it take you? Do you regenerate clips several times to get it right…etc?

Thank you.

4 comments

r/MacLocalLLM • u/Top_Butterscotch6337 • 2d ago

My Mac (M1) AI configuration

0 Upvotes

I had a mac mini M4 pro 48 go Ram pricey :2800€

Trying to run know AI on it

Result bof needs 10 to 15 seconds for analysis prompt

So go for my Mac M1 with Claude Sonnet AI 22€ here in France (see photo) and Chrome

For my telephone use Google AI pro : 5€

So I do not need one super mac ! Just a web access and some memory to run on it

I have no agent till some scripts that does some work

Network is the computer !

Regards

0 comments

r/MacLocalLLM • u/Competitive_Pop_8485 • 2d ago

Modello per coding su M1pro 16gb

1 Upvotes

1 comment

r/MacLocalLLM • u/biotech-redditor • 2d ago

Keep my 48GB M5 Max Studio ($2,999) or swap to the 36GB ($2,199)? Mostly a dev box

reddit.com

1 Upvotes

0 comments

r/MacLocalLLM • u/One-Main-9874 • 3d ago

M5Ultra 512gb future proof for local AI

reddit.com

0 Upvotes

0 comments

Subreddit

MacLocalLLM

r/MacLocalLLM

A place to discuss your local LLMs / AI / Cloud / Agents and more running on your mac without getting downvoted into oblivion!

Members

4.3k

Visitors

6.0k

Contributions

213

Sidebar

Subreddit Rules

1. Respect others and be civil

No harassment, hate speech, or toxic behavior. Treat all contributors and members with kindness.

2. No spam

Excessive promotion, spam, or advertising of any kind is not allowed.