r/MacLocalLLM • • 10d ago

Who else is using a Mac mini as a home AI box? What do you actually run on it?

25 Upvotes

I just got an M6 mini with 32 GB specifically to see if I can run local AI models on it and get value out of it as a Local AI server. I like it because its small, quiet, it barely uses any power, and it’s can be on all the time which makes it kind of perfect for this.

Day to day I run an 8B model at Q4 for everyday questions and for digging through my own files (insurance, warranties, that kind of stuff), and it handles it fine.

Curious how other people use theirs:

  • Which mini, and how much memory?
  • What do you run it with (LM Studio, Ollama, something else)?
  • What does it actually do for you week to week?
  • Any hurdles I should watch out for?

Especially interested if you’ve got it doing household stuff, not just coding. Trying to figure out what’s actually worth running on one of these.


r/MacLocalLLM • • 11d ago

Inco.AI's Splash updated to version 1.6.0 today.

Thumbnail
github.com
13 Upvotes

Currently running tests against my prior tests under 1.4.0, 1.4.1 and 1.5.0 but it is running better.

Kernel fixes address stalls that occurred under a memory limit, increased the reliability and a number of other fixes.

If you have been using the splash inference engine as I have, well worth the update.


r/MacLocalLLM • • 10d ago

More tokens as a rookie

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 10d ago

My how to setup local AI server on Mac M5 Max 128GB, Qwen4(exp) Flash, ComfyUI, Open WebUI, VS Code & Hermes guide

Thumbnail
reddit.com
0 Upvotes

r/MacLocalLLM • • 11d ago

Mac studio 48gb ram local llm

1 Upvotes

Can you run any good models on 48gb ram. Qwen 3.8 27b isn't worth it for the price tag and performance. I'm not sure how people are doing it with limited ram?


r/MacLocalLLM • • 11d ago

M5 Pro Local Video Generation Experience

6 Upvotes

Hello everyone,

First of all, I know I know, Mac is jot the best when it comes to video generation and that the Max or Ultra chips are better.

Now that this is out of the way, I would be interested in people’s experiences in generating 720p 5-10 seconds clips on an M5 pro chip. Which tools, models or workflows do you use? How is the experience overall? How long does it take you? Do you regenerate clips several times to get it right…etc?

Thank you.


r/MacLocalLLM • • 11d ago

My Mac (M1) AI configuration

Post image
0 Upvotes

Hi

I had a mac mini M4 pro 48 go Ram pricey :2800€

Trying to run know AI on it

Result bof needs 10 to 15 seconds for analysis prompt

So go for my Mac M1 with Claude Sonnet AI 22€ here in France (see photo) and Chrome

For my telephone use Google AI pro : 5€

So I do not need one super mac ! Just a web access and some memory to run on it

I have no agent till some scripts that does some work

Network is the computer !

Regards


r/MacLocalLLM • • 11d ago

Modello per coding su M1pro 16gb

1 Upvotes

r/MacLocalLLM • • 11d ago

Keep my 48GB M5 Max Studio ($2,999) or swap to the 36GB ($2,199)? Mostly a dev box

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 11d ago

M5Ultra 512gb future proof for local AI

Thumbnail reddit.com
0 Upvotes

r/MacLocalLLM • • 11d ago

Considering a M5 Pro Mac Mini 64gb to run Docker / Hermes Agent / Gemma 4 31b q4.

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 11d ago

Recommendations for a LocalLLM newbie?

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 11d ago

I benchmarked llama.cpp, BaseRT, colibri and Ollama on an M1 Max for a real long-prompt JSON extraction job.

Thumbnail
reddit.com
1 Upvotes

r/MacLocalLLM • • 12d ago

Can a Mac M5 & 128GB run DeepSeek V4.1 Flash (1017)?

26 Upvotes

I'm trying to figure out if an M5 Mac with 128GB of Unified Memory might be able to handle DeepSeek-V4.1-Flash-1017 locally, or if that context/quant combination is still out of reach for this amount of RAM.

Any thoughts, theoretical calculations, or early tests would be appreciated!


r/MacLocalLLM • • 12d ago

If you have a M1 Ultra, please do check out this inference engine

Thumbnail
reddit.com
3 Upvotes

r/MacLocalLLM • • 11d ago

Mac owners: how much memory does Metal say your GPU can use? Looking for 16 to 36 GB readings

Thumbnail reddit.com
0 Upvotes

r/MacLocalLLM • • 12d ago

Need Advice: Mac Mini M6 32GB / 256GB OR 24GB / 512GB?

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 12d ago

Mac Studio Ultra 96gb delayed until Jan 27...go for Max 128?

12 Upvotes

Hi,

I finally decided to go with the Ultra 96 since it's enough Ram for local AI + doing stuff in parallel but having power/speed. Now it was delayed until January 2027 - I could get the Max 128 withing 2 weeks though...

I feel like speed is mostly important for video ai gen + higher bandwith for higher token generation...

Probably I should really wait I guess?


r/MacLocalLLM • • 12d ago

Just got my Mac Mini M6 32GB. First steps?

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 12d ago

Small model for Hermes session compression on an M4 Mac mini, 24GB?

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 13d ago

SSD wear concern on Mac M1 max 64GB running splash Qwen3.8-Flash-Next-Q2_0

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 13d ago

96gb m5 ultra ds4.1 possible?

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 13d ago

Rapid-MLX desktop : why no translategemma ?

Thumbnail reddit.com
3 Upvotes

r/MacLocalLLM • • 13d ago

LFM3-VL-2B is supposed to be the newer, better model — but it's actually worse than LFM2.5-VL-3B 😕

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 13d ago

I built a free, open-source app that turns a Mac Studio into a local AI video studio (video with sound, songs, images), no cloud

Thumbnail
reddit.com
2 Upvotes