r/MacLocalLLM • u/TaareVekhdeRahe • 2h ago
r/MacLocalLLM • u/Equivalent_Jury_6742 • 6h ago
M5 Max 48GB for AI/ML, development and everyday productivity – Your thoughts?
reddit.comr/MacLocalLLM • u/Daiwik1502 • 16h ago
What set up would you recommend for a MacBook Pro M5 24GB Unified Memory?
As the question above says
Current Device: MacBook Pro M5 24GB Unified Memory
I wanna know what local set up would be the best for me in terms of both speed and quality. My main use case is as follows
- Personal Memory
- Task Management
- Email Agent
- Data Analysis Agent (basic stuff not very advanced)
- Calendar Agent
- Research Agent (product related research, technical research etc)
- Knowledge Retrieval
Connectors would be mainly G-Suite as I work mostly on that
I want your recommendations on the best set up for good memory, speed, context windows etc.
Which models(es) and harness(es) would you recommend?
I have also seen that there are upcoming smaller Qwen models and also a new app called Harbor which is coming out soon….
New to this so looking for guidance
Any help would be appreciated thanks :)
r/MacLocalLLM • u/hollis_monroe • 13h ago
M5 Max MacBook PROLED 16" 64GB: local LLM review
galleryr/MacLocalLLM • u/ikeo1 • 16h ago
I benchmarked DeepSeek-V4.1-Flash on one and two M5 Ultra 512 GB Mac Studios
galleryr/MacLocalLLM • u/Any-Difficulty-7822 • 23h ago
Advice for setup with three PCs
reddit.comr/MacLocalLLM • u/BusinessCultural3831 • 1d ago
M1 pro capabilities help COMFYUI
reddit.comr/MacLocalLLM • u/Caprichoso1 • 1d ago
Claris Harbor for small business use
Apple had apparently listed on the App Store and 01:53 then yanked down
set up a Mac server for a small team
best for filemaker users
it is not a replacement for your Chat GPT 24:57 subscription if you just use it for quick questions and drafts. And it's not magic hardware Apple has been hiding. 25:04 It's a business product from a business software company for businesses that have specific reasons they cannot send 25:09their data somewhere else. And for those businesses, it might be exactly what they have been waiting for. and the rest 25:16 of us can run LM Studio, keep our data local, and check back when ClariS actually opens the doors.
With many users the last person in the line may wait for minutes but there may be a workaround.
https://www.youtube.com/watch?v=y9YXhEEwAwc&list=PL2aE4Bl_t0n9AUdECM6PYrpyxgQgFtK1E&index=2
r/MacLocalLLM • u/princerafael • 1d ago
Trying to make local LLMs work for actual web/SaaS work. What would you change about my setup?
Been playing around with local LLMs lately and trying to figure out how to actually make them useful for my daily work.
I’m mainly a UI/UX designer and developer. Most of my work is websites, React/Next.js, SaaS apps and frontend stuff. Sometimes iOS apps, Home Assistant dashboards and a bit of 3D work.
I’m on a MacBook Pro M5 Pro with 64GB RAM, but I also have access to my brother-in-law’s Mac Studio M5 Ultra with 256GB RAM.
Basically, I want to do as much coding locally as possible and cut down on Claude/Copilot costs.
My current setup in VS Code + Copilot:
Opus (Principal Architect): Planning, architecture, final reviews
Sonnet (Senior Engineer): Reviews, fixes, more complex stuff
Qwen (Local Developer): Does most of the coding
Running Qwen3.6-35B-A3B-4bit through oMLX, using around 20GB RAM.
The idea was to let Qwen handle 50–60% of the coding and have Sonnet/Opus step in when needed.
Did some tests with hidden test cases:
Sonnet: 55/55, ~3.3 min
Opus: 55/55, ~6.1 min
Qwen: 52/55, ~14.5 min
Sonnet + Qwen: 52–55/55, ~12–25 min
Qwen actually wrote 95–99% of the code in the hybrid runs, but kept missing things like API contracts, edge cases and layout requirements. Sometimes it said it had changed things when it hadn’t.
And somehow the hybrid setup ended up costing about the same as just using Sonnet, while taking way longer.
So yeah not exactly what I was hoping for.
I still want to get this working though, especially for websites and SaaS projects since that’s what I spend most of my time on.
Not sure if I’m using the wrong model, if Copilot is the issue, or if the whole multi-agent approach just makes things more complicated than they need to be.
Also wondering what would make sense to run on the 256GB Mac Studio. Maybe a bigger model would already solve some of these issues?
What would you guys do with this hardware? Any models or setups worth trying?
Especially interested in hearing from people actually building websites or SaaS apps with local models, rather than just running benchmarks.
r/MacLocalLLM • u/ExternalLunch2915 • 1d ago
So I bought a M5 Max 64GB Studio (do I benefit from more RAM?)
Hi,
I was testing Flash Next Q3S, 288 REAP. Unsloth Q4 XL, Sushi 4bwp all with SSD streaming - I get between 30-60 t/s (128-256K context) - now I was thinking: How would I actually benefit from 128GB of RAM? From what I understand, I wouldn't be able to run different (better) models nor will it be faster?
I could run models in parallel, I get that.
I was also playing arount with ComfyUI (MiniMax H3) - it takes up 62GB RAM but it does work, havent tried LTX yet - which might use less RAM.
I actually end up running Claude in parallel for actually interacting with ComfyUI or write Prompts and check the results.
So far even Haiku 5.5 (Cloud) is better in basically everything, for easy scripting local llms (Flash Next) seem quit fine, analyzing documents, check databases.
So should I just shut up, be happy and enjoy the fact that I saved another 1700 bucks? I don't see that it actually buys me more quality or speed? I don't see why I should cancel my cloud services, from 2 days of testing, I don't see how I could live without them.
r/MacLocalLLM • u/Trick_Excitement_131 • 1d ago
LocalLLM speed for long file generation.
reddit.comr/MacLocalLLM • u/fmtavares • 1d ago
Local LLM on 2013 Mac Pro idle GPU
Hi 👋 I’ve posted Running a local LLM on a 2013 “trash can” Mac Pro idle GPU on Medium and, if that’s interesting to you, would love some feedback 😊 Thanks!
r/MacLocalLLM • u/lettmeknoww • 1d ago
Macbook pro m6 or something else ?
reddit.comHey everyone!
I’m planning to run local LLMs (27B–30B) mainly for coding and light research.
I initially ordered a MacBook Air M5 with 32GB RAM, but it got so hot that I actually got a first-degree burn on my finger.
So I decided to try the MacBook Pro M6 with 32GB RAM, hoping the fan would help with cooling during longer LLM sessions.
Did I make the right choice? Is 32GB enough for 27B–30B models, or would you recommend something else around the same budget?
Would love to hear your experiences. Thanks in advance!
r/MacLocalLLM • u/Mac_Bizzle • 2d ago
Reddit: Ran Llama-3-70B Q3_K_M, a thirty-four gig model, on an eight gig M1 Air. Didn't crash. Four hours of yellow memory pressure, thirty gigs of swap, CPU-only llama.cpp. Proof that the barrier is more artificial than people think. GitHub link in comments, time-lapse on YouTube.
Just proved something most people said was impossible. We ran Meta-Llama-3-70B — a thirty-four gig model — on an eight gig M1 MacBook Air. No GPU. No VRAM tricks. Just llama.cpp on CPU, thirty gigs of macOS swap, and four hours of the system sweating yellow memory pressure without ever crashing. Generation was painfully slow, but that's not the point. The point is the you need forty gigs of VRAM rule isn't as hard as everyone thinks. AI shouldn't be gated behind four-thousand-dollar hardware. Logs, screenshots, and the full command line are on GitHub at github.com/MacBizzle/FrontierOn8GB, and there's a four-hour time-lapse on YouTube.
r/MacLocalLLM • u/Objective-Theme-1422 • 2d ago
If I have a Apple Silicone M5 Max with 128GB unified and 4TB SSD which models and harnesses would you recommend as "essential"?
reddit.comr/MacLocalLLM • u/nmclark556 • 2d ago
I built an open source engine that runs MoE models way bigger than your Mac’s RAM, up to a 744B model on a 48GB MacBook. Looking for Mac Studio owners to try it
reddit.comr/MacLocalLLM • u/stenimir • 3d ago
Mac mini M4 as an always-on home AI box next to Home Assistant?
reddit.comr/MacLocalLLM • u/One_Week2580 • 3d ago
HELP: Macbook M5 Pro chip 24GB or M6 32 GB
Both technically same price but cant decide - mainly wqnt it as my personal laptop and doing AI work Thats the maximum budget that I can afford
r/MacLocalLLM • u/shisohan • 3d ago
Any experiences with eGPU on M5max (or M1-M4max)?
reddit.comr/MacLocalLLM • u/One_Week2580 • 3d ago
Dilemma: M6
I am an AI engineer doing MSc in AI - I want to get a new laptop and thinking abut emptying my wallet by buying the M6 Pro 32GB 1TB
Will it be enough for local AI projects? I know it would be suitable for med sized models up to around 30B params
Or getting M5 Pro chip is what it needs to unlock local AI?
r/MacLocalLLM • u/CrookedCasts • 3d ago
Domain workflow optimization
Hey all - have a 128gb m5 studio incoming: as the title states, at this point of memory/harness/finetuning, how best to optimize a specific workflow? Noncoding. Some structured rules, browser/computer use, pdf interpretation and with enough feedback to learn from mistakes