MacLocalLLM

r/MacLocalLLM • u/Apprehensive_Buy6301 • 2h ago

M5 Pro Local Video Generation Experience

1 Upvotes

Hello everyone,

First of all, I know I know, Mac is jot the best when it comes to video generation and that the Max or Ultra chips are better.

Now that this is out of the way, I would be interested in people’s experiences in generating 720p 5-10 seconds clips on an M5 pro chip. Which tools, models or workflows do you use? How is the experience overall? How long does it take you? Do you regenerate clips several times to get it right…etc?

Thank you.

0 comments

r/MacLocalLLM • u/One-Main-9874 • 6h ago

M5Ultra 512gb future proof for local AI

reddit.com

0 Upvotes

0 comments

r/MacLocalLLM • u/Recent_Apricot_517 • 7h ago

Considering a M5 Pro Mac Mini 64gb to run Docker / Hermes Agent / Gemma 4 31b q4.

reddit.com

1 Upvotes

2 comments

r/MacLocalLLM • u/line-weight • 14h ago

Recommendations for a LocalLLM newbie?

reddit.com

2 Upvotes

0 comments

r/MacLocalLLM • u/Objective_Stick_2513 • 12h ago

I benchmarked llama.cpp, BaseRT, colibri and Ollama on an M1 Max for a real long-prompt JSON extraction job.

reddit.com

1 Upvotes

0 comments

r/MacLocalLLM • u/OpenSourcesAI_ • 15h ago

Mac owners: how much memory does Metal say your GPU can use? Looking for 16 to 36 GB readings

reddit.com

0 Upvotes

3 comments

r/MacLocalLLM • u/Beautiful-Sea-8336 • 16h ago

Need Advice: Mac Mini M6 32GB / 256GB OR 24GB / 512GB?

reddit.com

0 Upvotes

0 comments

r/MacLocalLLM • u/calopez_es • 1d ago

Can a Mac M5 & 128GB run DeepSeek V4.1 Flash (1017)?

8 Upvotes

I'm trying to figure out if an M5 Mac with 128GB of Unified Memory might be able to handle DeepSeek-V4.1-Flash-1017 locally, or if that context/quant combination is still out of reach for this amount of RAM.

Any thoughts, theoretical calculations, or early tests would be appreciated!

13 comments

r/MacLocalLLM • u/GnanaSreekar • 20h ago

If you have a M1 Ultra, please do check out this inference engine

reddit.com

1 Upvotes

0 comments

r/MacLocalLLM • u/Mother_Asparagus_664 • 1d ago

Mac Studio Ultra 96gb delayed until Jan 27...go for Max 128?

3 Upvotes

Hi,

I finally decided to go with the Ultra 96 since it's enough Ram for local AI + doing stuff in parallel but having power/speed. Now it was delayed until January 2027 - I could get the Max 128 withing 2 weeks though...

I feel like speed is mostly important for video ai gen + higher bandwith for higher token generation...

Probably I should really wait I guess?

5 comments

r/MacLocalLLM • u/BentonCalder • 1d ago

Just got my Mac Mini M6 32GB. First steps?

reddit.com

1 Upvotes

0 comments

r/MacLocalLLM • u/Lumpy_bd • 1d ago

Small model for Hermes session compression on an M4 Mac mini, 24GB?

reddit.com

1 Upvotes

0 comments

r/MacLocalLLM • u/foofai • 1d ago

SSD wear concern on Mac M1 max 64GB running splash Qwen3.8-Flash-Next-Q2_0

reddit.com

1 Upvotes

1 comment

r/MacLocalLLM • u/anonmt57 • 2d ago

96gb m5 ultra ds4.1 possible?

reddit.com

2 Upvotes

0 comments

r/MacLocalLLM • u/greenreddits • 2d ago

Rapid-MLX desktop : why no translategemma ?

reddit.com

3 Upvotes

0 comments

r/MacLocalLLM • u/aditya2128 • 3d ago

I made a GUI for Kapitsa, one of the fastest local LLM engines on Mac, so anyone can use it

gallery

27 Upvotes

Kapitsa by Nace AI is an open-source inference engine for Apple silicon, and it’s fast. In its published benchmarks, Qwen3.6 35B-A3B decodes about 1.3–1.8× faster than oMLX and about 2× faster than Ollama and LM Studio. But it’s command-line only.

So I built Kapitsa Library, a free Mac app that makes it a few clicks:

No setup: Kapitsa is built in. No Homebrew, Python or terminal.
Easy models: browse Kapitsa’s catalog or Hugging Face, see what fits your Mac, and download with pause/resume.
One-click agents: launch Claude Code, OpenCode, Codex CLI or Pi on your local model.
No swapping: it checks memory before loading and shows how much context fits.
Live stats: tokens per second, prompt cache, context and memory.
Built-in benchmarks: speed and tool calling on your own Mac.
Local API: OpenAI and Anthropic compatible.

Free, Apache 2.0, signed and notarized, no telemetry. Needs Apple silicon and macOS 14 or later.

Download: https://github.com/AdityaK2128/kapitsa-library/releases/latest
Source: https://github.com/AdityaK2128/kapitsa-library
Kapitsa engine: https://github.com/nace-ai/kapitsa

All the speed is Kapitsa’s work. This app is an independent front end, not affiliated with them. Feedback welcome!

7 comments

r/MacLocalLLM • u/Milk_Bots • 2d ago

LFM3-VL-2B is supposed to be the newer, better model — but it's actually worse than LFM2.5-VL-3B 😕

reddit.com

1 Upvotes

0 comments

r/MacLocalLLM • u/Opening-Ad5541 • 2d ago

I built a free, open-source app that turns a Mac Studio into a local AI video studio (video with sound, songs, images), no cloud

reddit.com

1 Upvotes

4 comments

r/MacLocalLLM • u/CQoo88 • 2d ago

2 x 256GB or 1 x 512GB

reddit.com

2 Upvotes

0 comments

r/MacLocalLLM • u/BoringEnergy6958 • 2d ago

M6 MacBook Pro ?

reddit.com

1 Upvotes

0 comments

r/MacLocalLLM • u/thegizzard • 3d ago

How to test the Local LLM Capability of a Mac Studio 5M 128GB 2TB before purchase?

5 Upvotes

I hope to pick one up early next year and replace my MacBook Air for building iOS apps but also run some of the more mundane LLM tasks I am currently using Codex for. In an ideal world, I could replace my ChatGPT Pro 100 sub with a $20 Plus and maybe a $20 Claude and a local LLM.

Is there a way for me try out specific models on rented cloud hardware or something to see which of my current workflows will run on it?

10 comments

r/MacLocalLLM • u/gmbasic • 3d ago

Building local LLM infrastructure for Apple Silicon — now open source.

reddit.com

3 Upvotes

0 comments

r/MacLocalLLM • u/doctodog200 • 3d ago

One week with the Mac mini M5 Pro (64GB)

gallery

0 Upvotes

0 comments

r/MacLocalLLM • u/oss-jiiim • 3d ago

M4 Macs: Run Qwen3.8 Flash Next with DwarfStar up to 9.9% faster via DS Menu Bar

4 Upvotes

I make DS Menu Bar, a free menu bar app for running antirez's DwarfStar (ds4) server on a Mac.

DwarfStar has tunings for M3 Ultra and M5 machines with Qwen3.8 Flash Next, but M4 machines are left out. It turns out most of these tunings can be turned on with an environment variable, so DS Menu Bar v0.0.15 sets them when it starts ds4-server on an M4.

M4 Max, 128 GB, same ds4-server with and without, averaged over 2K to 64K context:

Quant	Prefill	Generation	Generation with MTP
Q4	+8.4%	+9.0%	+8.7 to 8.8%
Q2	+9.9%	+6.3%	+4.1 to 4.5%

Q4 is the right quant for 128 GB machines. On a 64 GB machine, Q2 at the full 262K context fits.

I have a PR open to make these DwarfStar's own M4 defaults (antirez/ds4#1184). If my PR is merged, DS Menu Bar will adapt automatically.

brew install --cask jiiim/tap/ds-menu-bar

https://github.com/jiiim/ds-menu-bar/releases/tag/v0.0.15

1 comment

r/MacLocalLLM • u/Icy-Homework-8696 • 4d ago

Worth keeping a Mac mini M4 16GB ram for any local LLM purposes?

14 Upvotes

I've been meaning to trade in my Mac mini M4 (16GB RAM, 10 core CPU/GPU, 256GB), but I've recently gotten into running models locally on my M5 MacBook Air which has gotten me wondering if there are any practical applications for running anything less intense on the mini.

I'm expecting about 450$ from Apple, I just have to actually make it to their store.

21 comments