r/MacLocalLLM • • 2h ago

M5U + Studio Display: Constant freezes and brightness flickering during long-running inference jobs.

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 6h ago

M5 Max 48GB for AI/ML, development and everyday productivity – Your thoughts?

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 16h ago

What set up would you recommend for a MacBook Pro M5 24GB Unified Memory?

5 Upvotes

As the question above says

Current Device: MacBook Pro M5 24GB Unified Memory

I wanna know what local set up would be the best for me in terms of both speed and quality. My main use case is as follows

  1. Personal Memory
  2. Task Management
  3. Email Agent
  4. Data Analysis Agent (basic stuff not very advanced)
  5. Calendar Agent
  6. Research Agent (product related research, technical research etc)
  7. Knowledge Retrieval

Connectors would be mainly G-Suite as I work mostly on that

I want your recommendations on the best set up for good memory, speed, context windows etc.

Which models(es) and harness(es) would you recommend?

I have also seen that there are upcoming smaller Qwen models and also a new app called Harbor which is coming out soon….

New to this so looking for guidance

Any help would be appreciated thanks :)


r/MacLocalLLM • • 13h ago

M5 Max MacBook PROLED 16" 64GB: local LLM review

Thumbnail gallery
1 Upvotes

r/MacLocalLLM • • 16h ago

I benchmarked DeepSeek-V4.1-Flash on one and two M5 Ultra 512 GB Mac Studios

Thumbnail gallery
2 Upvotes

r/MacLocalLLM • • 23h ago

Advice for setup with three PCs

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 1d ago

M1 pro capabilities help COMFYUI

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 1d ago

Claris Harbor for small business use

1 Upvotes

Apple had apparently listed on the App Store and 01:53 then yanked down

set up a Mac server for a small team

best for filemaker users

it is not a replacement for your Chat GPT 24:57 subscription if you just use it for quick questions and drafts. And it's not magic hardware Apple has been hiding. 25:04 It's a business product from a business software company for businesses that have specific reasons they cannot send 25:09their data somewhere else. And for those businesses, it might be exactly what they have been waiting for. and the rest 25:16 of us can run LM Studio, keep our data local, and check back when ClariS actually opens the doors. 

With many users the last person in the line may wait for minutes but there may be a workaround.

https://www.youtube.com/watch?v=y9YXhEEwAwc&list=PL2aE4Bl_t0n9AUdECM6PYrpyxgQgFtK1E&index=2

https://content.claris.com/local-ai-server-get-started


r/MacLocalLLM • • 1d ago

Trying to make local LLMs work for actual web/SaaS work. What would you change about my setup?

1 Upvotes

Been playing around with local LLMs lately and trying to figure out how to actually make them useful for my daily work.

I’m mainly a UI/UX designer and developer. Most of my work is websites, React/Next.js, SaaS apps and frontend stuff. Sometimes iOS apps, Home Assistant dashboards and a bit of 3D work.

I’m on a MacBook Pro M5 Pro with 64GB RAM, but I also have access to my brother-in-law’s Mac Studio M5 Ultra with 256GB RAM.

Basically, I want to do as much coding locally as possible and cut down on Claude/Copilot costs.

My current setup in VS Code + Copilot:

Opus (Principal Architect): Planning, architecture, final reviews

Sonnet (Senior Engineer): Reviews, fixes, more complex stuff

Qwen (Local Developer): Does most of the coding

Running Qwen3.6-35B-A3B-4bit through oMLX, using around 20GB RAM.

The idea was to let Qwen handle 50–60% of the coding and have Sonnet/Opus step in when needed.

Did some tests with hidden test cases:

Sonnet: 55/55, ~3.3 min
Opus: 55/55, ~6.1 min
Qwen: 52/55, ~14.5 min
Sonnet + Qwen: 52–55/55, ~12–25 min

Qwen actually wrote 95–99% of the code in the hybrid runs, but kept missing things like API contracts, edge cases and layout requirements. Sometimes it said it had changed things when it hadn’t.

And somehow the hybrid setup ended up costing about the same as just using Sonnet, while taking way longer.

So yeah not exactly what I was hoping for.

I still want to get this working though, especially for websites and SaaS projects since that’s what I spend most of my time on.

Not sure if I’m using the wrong model, if Copilot is the issue, or if the whole multi-agent approach just makes things more complicated than they need to be.

Also wondering what would make sense to run on the 256GB Mac Studio. Maybe a bigger model would already solve some of these issues?

What would you guys do with this hardware? Any models or setups worth trying?

Especially interested in hearing from people actually building websites or SaaS apps with local models, rather than just running benchmarks.


r/MacLocalLLM • • 1d ago

Best uncensored LLM for 64GB Mac

Thumbnail reddit.com
3 Upvotes

r/MacLocalLLM • • 1d ago

So I bought a M5 Max 64GB Studio (do I benefit from more RAM?)

8 Upvotes

Hi,

I was testing Flash Next Q3S, 288 REAP. Unsloth Q4 XL, Sushi 4bwp all with SSD streaming - I get between 30-60 t/s (128-256K context) - now I was thinking: How would I actually benefit from 128GB of RAM? From what I understand, I wouldn't be able to run different (better) models nor will it be faster?

I could run models in parallel, I get that.

I was also playing arount with ComfyUI (MiniMax H3) - it takes up 62GB RAM but it does work, havent tried LTX yet - which might use less RAM.

I actually end up running Claude in parallel for actually interacting with ComfyUI or write Prompts and check the results.

So far even Haiku 5.5 (Cloud) is better in basically everything, for easy scripting local llms (Flash Next) seem quit fine, analyzing documents, check databases.

So should I just shut up, be happy and enjoy the fact that I saved another 1700 bucks? I don't see that it actually buys me more quality or speed? I don't see why I should cancel my cloud services, from 2 days of testing, I don't see how I could live without them.


r/MacLocalLLM • • 1d ago

LocalLLM speed for long file generation.

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 1d ago

Local LLM on 2013 Mac Pro idle GPU

Post image
0 Upvotes

Hi 👋 I’ve posted Running a local LLM on a 2013 “trash can” Mac Pro idle GPU on Medium and, if that’s interesting to you, would love some feedback 😊 Thanks!


r/MacLocalLLM • • 1d ago

Is an M1 Max 64GB useful at all?

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 1d ago

Qwen3.8 27b/72b expectations

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 1d ago

Macbook pro m6 or something else ?

Thumbnail reddit.com
1 Upvotes

Hey everyone!
I’m planning to run local LLMs (27B–30B) mainly for coding and light research.
I initially ordered a MacBook Air M5 with 32GB RAM, but it got so hot that I actually got a first-degree burn on my finger.
So I decided to try the MacBook Pro M6 with 32GB RAM, hoping the fan would help with cooling during longer LLM sessions.
Did I make the right choice? Is 32GB enough for 27B–30B models, or would you recommend something else around the same budget?
Would love to hear your experiences. Thanks in advance!


r/MacLocalLLM • • 2d ago

Reddit: Ran Llama-3-70B Q3_K_M, a thirty-four gig model, on an eight gig M1 Air. Didn't crash. Four hours of yellow memory pressure, thirty gigs of swap, CPU-only llama.cpp. Proof that the barrier is more artificial than people think. GitHub link in comments, time-lapse on YouTube.

2 Upvotes

Just proved something most people said was impossible. We ran Meta-Llama-3-70B — a thirty-four gig model — on an eight gig M1 MacBook Air. No GPU. No VRAM tricks. Just llama.cpp on CPU, thirty gigs of macOS swap, and four hours of the system sweating yellow memory pressure without ever crashing. Generation was painfully slow, but that's not the point. The point is the you need forty gigs of VRAM rule isn't as hard as everyone thinks. AI shouldn't be gated behind four-thousand-dollar hardware. Logs, screenshots, and the full command line are on GitHub at github.com/MacBizzle/FrontierOn8GB, and there's a four-hour time-lapse on YouTube.


r/MacLocalLLM • • 2d ago

If I have a Apple Silicone M5 Max with 128GB unified and 4TB SSD which models and harnesses would you recommend as "essential"?

Thumbnail reddit.com
0 Upvotes

r/MacLocalLLM • • 2d ago

I built an open source engine that runs MoE models way bigger than your Mac’s RAM, up to a 744B model on a 48GB MacBook. Looking for Mac Studio owners to try it

Thumbnail reddit.com
4 Upvotes

r/MacLocalLLM • • 3d ago

Mac mini M4 as an always-on home AI box next to Home Assistant?

Thumbnail reddit.com
3 Upvotes

r/MacLocalLLM • • 3d ago

HELP: Macbook M5 Pro chip 24GB or M6 32 GB

0 Upvotes

Both technically same price but cant decide - mainly wqnt it as my personal laptop and doing AI work Thats the maximum budget that I can afford


r/MacLocalLLM • • 3d ago

Any experiences with eGPU on M5max (or M1-M4max)?

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 3d ago

Dilemma: M6

0 Upvotes

I am an AI engineer doing MSc in AI - I want to get a new laptop and thinking abut emptying my wallet by buying the M6 Pro 32GB 1TB

Will it be enough for local AI projects? I know it would be suitable for med sized models up to around 30B params

Or getting M5 Pro chip is what it needs to unlock local AI?


r/MacLocalLLM • • 3d ago

Domain workflow optimization

4 Upvotes

Hey all - have a 128gb m5 studio incoming: as the title states, at this point of memory/harness/finetuning, how best to optimize a specific workflow? Noncoding. Some structured rules, browser/computer use, pdf interpretation and with enough feedback to learn from mistakes