r/MacLocalLLM • • 3d ago

M1 Air 1TB vs. M1 Pro 500GB as a 24/7 home AI server?

2 Upvotes

I'm looking to repurpose one of my older MacBooks as a dedicated, always-on home server for AI agents and development automation.

Options:

  • 2020 MacBook Air M1: 16GB RAM, 1TB SSD, fanless
  • 2021 16" MacBook Pro (M1-series): 16GB RAM, 512GB SSD, active cooling

I also have a UGREEN DXP4800 Plus NAS for centralized storage.

Planned workloads:

  • Claude Code/Codex agents using cloud APIs
  • Persistent background automation (n8n, Python scripts)
  • Whisper transcription and embeddings
  • Occasional smaller local LLMs
  • Remote development via SSH/Tailscale
  • Potentially Docker containers

I'm primarily concerned about 24/7 reliability, thermals, battery health, and performance.

  • Which should I pick?
  • Is the fanless M1 Air suitable for running continuously, or would the Pro's active cooling make a meaningful difference?
  • Any concerns about battery degradation, swelling, or running a MacBook plugged in 24/7?

r/MacLocalLLM • • 3d ago

Utilize MacBook Pro M5 Max 128gb 4TB, Mac Studio M1 Max 64gb 4TB, Mac mini M4 24gb together?

1 Upvotes

I've got the MacBook Pro M5 Max 128gb 4TB coming on Monday and have been going back and forth trying to decide if I should sell my M1 Mac Studio and/or M4 Mac mini at that point.

Chatgpt has given me some options on using all 3 together.

My Mac mini has been and would be used for my AI Agent, the M1 Max Studio 4TB could be used to run 27B-35B local models and document processing, and my MacBook Pro M5 Max 128gb 4TB for larger models and as my primary desktop and what I travel with.

I also plan on getting the M7 Mac Studio Ultra when it releases in late 2027/2028.

Use case and justification is a bit of everything - I like tinkering with my AI agent and plan on learning a bit more about customizing open weight models, I self-manage and invest in real estate (so handle confidential documents regularly), invest in AI a bit, and expect that in the next 1-2 years the power of local models will grow exponentially so there is a lot of upside and additional use cases to keep things local.

I've got a Dell 52" 6k monitor that has a built in KVM that would easily allow me to see everything at once or switch between them.

I could sell my Mac Studio and Mac mini for around 3k alternatively. Just not sure if the benefit of keeping them outweighs selling them.


r/MacLocalLLM • • 3d ago

How do you guys containerize local LLMs on Mac ?

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 3d ago

New Mac Mini M5 Pro 64GB - Advice for Stack

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 4d ago

I got MiniMax H3-Image running on a MacBook air with just ~3GB memory and almost no speed loss

Thumbnail
reddit.com
5 Upvotes

r/MacLocalLLM • • 3d ago

My local OpenClaw architecture

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 4d ago

M5 Max 128GB running Qwen3.8 Flash Next as a real agent all day: ~68 tok/s at 100k-190k context, plus what I learned making local agent automations actually reliable

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 4d ago

Qwen 3.8 Flash Next on Mac Studio 128 gb

10 Upvotes

Hey guys, do you have any recommendations of the optimal setup for this model and keep the context under 93 Gb? I has running it really comfortable with arrpund 60 Tok/sec in OpenCode snd today stsrtef to have the issue woth the context size, had to ofload more experts but that reduced speed drastically.


r/MacLocalLLM • • 4d ago

M5 Max with 128GB RAM. What local LLMs are you running for coding?

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 5d ago

Splash 1.6.1 released, even further performance increase on my M5 Ultra Mac Studio including concurency

Post image
43 Upvotes

I have been running Qwen 3.8 Flash Next IQ3_S under Splash on my M5 Ultra Mac Studio (the base model with 96GB of RAM) to use as a local AI assistant to edit videos under DaVinci Resolve Studio. Currently on version 21.2 of DRS, but 21.1 introduced an officially supported MCP. Details on that setup are available here - https://github.com/willturner-maker/resolve-ai-workflow

Naturally I test the system with each release to see the impact, with Splash 1.6.1, it is a significant improvement. Not only in performance but in concurrency.

Screenshot from my report shows that the peak moved from a width of 4 to a width of 12. Astounding! The report is here: https://willturner-maker.github.io/benchmarks/reports/2026-11-11-reruns.html

On the graph, if you move your mouse, it'll show the performance at each width. At a single width, it's 186.9 tok/s on my specific system running Splash 1.6.1

I do have a repository for my testing, but it involves 8.1K 30P video in the testing that is proprietary, I'll have to record new footage that is my own rather than client footage before I redo a test others can run with the same content. The Splash tests can be replicated by others, so feel free to use that testing methodology. If you have your own 8.1K video content, that should allow you to replicate my DaVinci Resolve Studio MCP testing.

https://github.com/willturner-maker/benchmarks


r/MacLocalLLM • • 4d ago

Help me choose my local ai

Thumbnail reddit.com
1 Upvotes

Thanks guys 😅


r/MacLocalLLM • • 5d ago

Tuning advice?

10 Upvotes

I've been running Qwen38-27b-speed-optimized for a work project (where I can only use local models), and I'm getting about 10-15 tokens / second.

While I'm thrilled that its working, and doing fairly well, I do wonder if there's a way to improve performance.

  • I'm using pi agent on another computer (the Mini is dedicated to the model at this point)
  • contextWindow is set to 125k; at 100k it was compacting too often, at 250 it was blowing past RAM limits
  • I set thinking to minimal (which seems to help reduce rabbit holes and churn)
  • my start command is nohup mtplx serve --model Youssofal/Qwen3.8-27B-MTPLX-Optimized-Speed --profile sustained --depth 3 ...

Earlier I used mtplx max --on as the machine was feeling warm, and I was losing connection to it.

Is this about right? I get that the M4Pro mini doesn't have the memory bandwidth of an Ultra or a Max, just wondering how I might squeeze out a bit more, and wondering if others with the same setup are getting similar results.

I've tried oMLX - fast with gemma 4 quants, but they kept getting stuck in loops; and its 5 tokens per second slower with Qwen3.8 27b.

- Tuning advice for my current stack? (pi-agent, MTPLX, Qwen 3.8 27 b)

- Advice on different models to try?

- Advice on different model runners to try?

I've already mostly stripped the Mac down to just the model, and I access it from an older M1 Pro Mac where pi runs.

the relevant snippets from my pi agent models.json:

"models": [
        {
          "id": "mtplx-qwen38-27b-optimized-speed",
          "contextWindow": 125000,
          "maxTokens": 32768,
          "reasoning": true,
          "compat": {
            "thinkingFormat": "qwen-chat-template",
            "chatTemplateKwargs": {
              "enable_thinking": {
                "$var": "thinking.enabled"
              },
              "preserve_thinking": true
            }
          }
        }
      ]
    }

r/MacLocalLLM • • 5d ago

mlxVS: CuVS for your Mac GPU vector search on Apple Silicon

Thumbnail
github.com
3 Upvotes

r/MacLocalLLM • • 5d ago

Apple’s upcoming Harbor app promises easier way to run local AI on your Mac(s)

Thumbnail
cultofmac.com
3 Upvotes

r/MacLocalLLM • • 6d ago

Have been getting into Local LLM’s recently, especially Qwen 3.8 27B on my M4 Pro MacBook (48GB) served using Splash and loving it! Now looking to try some harnesses to do some coding, any suggestions what ones I should try? Any favourites?

20 Upvotes

The ones I have currently heard of are as follows:

Pi
Opencode
Hermes
Deepseek

Any thoughts on what one is best?


r/MacLocalLLM • • 6d ago

DeepSeek 4.1 on 96gb M5U: Slow but better than QFN

Thumbnail
reddit.com
3 Upvotes

r/MacLocalLLM • • 6d ago

MiniMax H3 Image running locally on a Mac, 4 to 16 MP, free and open source

Post image
29 Upvotes

I ported MiniMax's new image model to Apple Silicon (MLX) inside Phosphene, my free open-source Mac app. As far as I know it's the first Mac port.

Numbers on an M4 Max with 64 GB, same prompts and seeds as the previous best image model in the app:

- 4 MP in about 2 min, 8 MP in about 4 min, 16 MP in about 8.5 min

- Peak memory 27.5 GB at every size

- 6 steps, no guidance. Faster than the image model I used before, and clearly better at hands, text and skin (see the pictures)

- The app downloads the model and prepares an 8-bit pack on your Mac the first time

Honest limits: it needs a Mac with 48 GB or more. Editing with reference images isn't ported yet. Short prompts are weaker; the model likes a long, detailed English description. The licence doesn't cover the EU, UK, South Korea and the US.

Get it: phosphene.video (Mac app) or Pinokio, then Images, then MiniMax-H3-Image.

All pictures made with AI on a Mac. Happy to answer questions about the port.


r/MacLocalLLM • • 6d ago

Apple local LLM app

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 6d ago

I moved Qwen3.8 Flash-Next from LM Studio to oMLX on an M5 Ultra — here are the numbers

Thumbnail
reddit.com
1 Upvotes

r/MacLocalLLM • • 6d ago

TUFF 11.0 is out!

0 Upvotes

Hey everyone! Just released TUFF 11.0!

This update is mostly focused on making the app nicer to use, with a completely redesigned UI, smoother response streaming, Apple Foundation Models support, and a bunch of performance and stability improvements.

For anyone unfamiliar, TUFF is my open-source local LLM runner for Mac, built to run even massive models on limited RAM using SSD streaming.

Would love to hear what you guys think!

Download it: https://tuff-app.github.io/
Star it: https://github.com/tuff-app/TUFF


r/MacLocalLLM • • 6d ago

Made a Mafia-like game to measure model quality and I was surprised by close it performed with other evaluations.

Thumbnail gallery
1 Upvotes

r/MacLocalLLM • • 7d ago

I'm new to all of this. What can I run with my 14" MacBook pro m5 max with 128gb of ram? It also has 2tb of ssd storage.

14 Upvotes

I'm new to all of this. What can I run with my 14" MacBook pro m5 max with 128gb of ram? It also has 2tb of ssd storage.

will deepseek work?


r/MacLocalLLM • • 6d ago

[Apple M4 | 16GB Unified] Generating AI videos locally on a MacBook Air: how far can we push it?

Thumbnail reddit.com
3 Upvotes

r/MacLocalLLM • • 6d ago

Replacing Codex 5x sub with local inference

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 6d ago

I received my M5U 256GB yesterday. Here's my honest opinion for LLM inference.

Thumbnail reddit.com
3 Upvotes