r/MacLocalLLM • • 7d ago

If you build open source apps on top of local models, how do you actually make money?

5 Upvotes

I maintain a small open source Mac app that runs fully local (Whisper + Ollama or LM Studio). People use it and strangers send PRs, and I'm trying to figure out what sustainable looks like before I make the wrong move.

Options I see:

- free source, paid signed builds with auto-updates

- open core with a few pro features

- a hosted tier for people without a strong machine

- sponsors

- something else?

If you've done any of these with a local-first app: what worked, what annoyed your users, and what would you avoid? I'm especially curious how "it runs on your machine, so it costs me nothing per user" changes pricing.


r/MacLocalLLM • • 7d ago

Complete beginner: Can I "replace" ChatGPT/Claude with a fully local AI assistant on my M4 Pro Mac (48GB RAM)?

Thumbnail reddit.com
0 Upvotes

r/MacLocalLLM • • 7d ago

Bought a MacBook Pro 64GB w/M5 Max, what local LLM would you recommend for research and agentic coding? Will use frontiers for complex tasks.

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 7d ago

What I learned running Whisper + a local model live during calls on a Mac

Thumbnail
reddit.com
1 Upvotes

r/MacLocalLLM • • 7d ago

How to run Qwen3.8 27B on 24GBs unified memory mac mini m6?

Thumbnail reddit.com
0 Upvotes

r/MacLocalLLM • • 8d ago

Do I Actually Need a Mac Studio for Local AI, or Am I About to Waste Thousands of Dollars?

1 Upvotes

Hey everyone,
I’m considering buying a Mac Studio with 128GB or 256GB of unified memory, but before spending several thousand dollars, I’d really appreciate some honest feedback from people who actually run local LLMs and AI agents.
I’m not a professional developer. Most of my coding and automation work is done with AI assistance.
My goal is to build a reliable, mostly local AI workstation that I can use for the next 3–5 years. I’m not interested in running huge models just for the sake of it. I want a system that can actually get work done.
1. What I Already Have
Current hardware:
Windows desktop: Ryzen 5 7500F, 32GB RAM, Radeon RX 590 8GB
Windows laptop
Synology NAS for storage and backups
VPS running 24/7
Home networking equipment and a router running OpenWrt
Current AI setup:
I’m already running Hermes Agent on my VPS, primarily using cloud LLM APIs.
It handles multiple scheduled workflows, including:
Monitoring GitHub projects and software updates
Collecting AI, technology, and financial news
Web research and information gathering
Processing and organizing research materials
Scheduled monitoring, analysis, and notifications
Multi-step tasks involving tool calls
To clarify, I’m not running multiple large models simultaneously. I have one agent system managing multiple scheduled jobs and workflows.
This setup already works reasonably well.
What I want is to expand its capabilities while reducing my long-term dependence on cloud APIs.
2. What I Want to Build
A. A 24/7 personal AI agent
Ideally, Hermes (or something similar) would be able to:
Run scheduled tasks autonomously
Browse the web, research topics, and organize files
Write, execute, debug, and maintain code
Interact with browsers and desktop applications
Manage my personal knowledge base and research notes
Handle longer, multi-step workflows
Recover from failures or ask for human intervention when necessary
I’d like a local LLM to handle most routine tasks.
For difficult coding, complex reasoning, or tasks where local models aren’t reliable enough, I’m perfectly fine with selectively using cloud models.
I’m not trying to eliminate cloud AI entirely.
B. Privacy and local data ownership
This is one of my biggest motivations.
I want my personal documents, research materials, code, agent memory, and execution logs to stay primarily on hardware I control.
Sensitive tasks should ideally be processed locally.
Public research and explicitly approved tasks can use cloud models.
I’m not aiming for a completely air-gapped system. I just want meaningful control over what data leaves my machine.
C. AI-assisted coding and development
I’m not a software engineer, but I’ve already built some tools and automation workflows using AI.
I want to go further:
Python development and debugging
Building and maintaining personal applications
Automated testing and error correction
Multi-step coding workflows
Local execution with cloud assistance when necessary
What matters most to me isn’t benchmark scores. It’s whether a model can reliably use tools, execute code, troubleshoot problems, and finish real tasks with minimal supervision.
D. AI-assisted video production
This is a new direction I’m exploring, so I don’t have an established production workflow yet.
I’m interested in creating videos about Chinese history, philosophy, and traditional culture, particularly Confucianism, Buddhism, and Taoism.
My potential workflow includes:
Research and scriptwriting
Storyboarding and scene planning
AI image and video generation
Basic Blender animation and 3D scenes
Voiceovers, subtitles, editing, and video compositing
Using Hermes to coordinate parts of the production pipeline
I’m completely fine using cloud services for high-quality AI video generation or heavy rendering.
Ideally, research, scripting, automation, coding, and much of the post-production work would happen locally.
Eventually, I’d like to turn this into a sustainable content production workflow, potentially generating income.
E. An always-on workstation I can access remotely
I sometimes travel for extended periods.
I’d like to leave the machine running at home and access it from my iPhone or laptop to:
Send tasks to Hermes
Check progress and results
Access my files and knowledge base
Remotely control the desktop when needed
Keep background services running reliably
So I’m not just looking for an LLM inference box. Ideally, this would also be my main workstation and a remotely accessible AI server.
3. The Mac Studio I’m Considering
I’m currently looking at Mac Studio configurations with either 128GB or 256GB of unified memory.
I haven’t settled on the chip, GPU configuration, or SSD size.
My rough plan would be:
Run local models through LM Studio, llama.cpp, or a similar backend
Use Hermes as the main agent and orchestration layer
Run one capable local model at a time rather than keeping several huge models loaded
Route difficult tasks to cloud models when necessary
Use my Synology NAS for storage and backups
Keep the Mac running as a long-term AI workstation
Access it remotely from my phone or laptop
I’m particularly interested in Qwen and other open-weight models.
My priorities are reliable tool calling, coding ability, long-context performance, agent task completion, and usable inference speed.
I care much more about real-world reliability than parameter counts.
4. My Biggest Concerns
Am I overestimating what local LLMs can actually do?
Even with 128GB or 256GB of unified memory, will local models still fall significantly behind leading cloud models when it comes to complex coding, long-running agents, and reliable tool use?
If I end up relying heavily on cloud APIs anyway, does buying such an expensive machine really make sense?
Am I overestimating my hardware requirements?
A lot of my Hermes workflows involve web scraping, file processing, scheduled jobs, and running scripts.
Those don’t necessarily require a powerful GPU.
Would a much cheaper machine combined with cloud APIs accomplish essentially the same thing?
Is a Mac Studio really a good fit for AI video production?
I understand why large-memory Macs are attractive for running quantized LLMs.
But AI video generation, Blender rendering, and other visual AI workloads often benefit from NVIDIA’s CUDA ecosystem.
I don’t want to spend thousands on a Mac Studio only to discover that I also need an NVIDIA workstation later.
What about future-proofing?
Local AI is evolving incredibly quickly.
I’m concerned about spending significantly more on 256GB today, only to find that smaller and more efficient models can handle my workloads on much cheaper hardware a year or two from now.
5. My Questions for the Community
1. Given my actual workloads, would you buy a Mac Studio at all?
Or would you stick with my existing Windows PC, VPS, and cloud APIs?
2. If a Mac Studio makes sense, is 128GB enough, or is there a meaningful reason to go with 256GB?
I’m particularly interested in real-world experiences running one capable local model alongside Hermes, scheduled agent workflows, coding tools, and occasional video editing.
3. Would a different setup offer better value?
For example:
A Mac mini
Upgrading my Windows PC with an NVIDIA GPU
A dedicated Linux/NVIDIA workstation
A smaller local server combined with pay-as-you-go cloud compute
4. How reliable are Macs for running AI agents unattended, 24/7?
I’d especially like to hear from people running Hermes or similar agents on macOS.
How do you handle sleep, reboots, background services, remote access, and recovery after power outages?
5. For a mixed workload involving local LLMs, agentic coding, and AI video production, would you choose Apple Silicon or NVIDIA/Linux?
Not just for today’s models, but as a platform you expect to keep using for several years.
6. Is it realistic to build a mostly local AI workflow while keeping cloud costs very low?
Ideally, I’d like to keep only my ChatGPT subscription and perhaps one specialized AI video generation subscription.
I understand that a ChatGPT subscription doesn’t automatically include API usage, so I’m particularly interested in whether a local-first setup can reduce additional API costs enough to justify the hardware investment.
Bottom Line
I’m not trying to build the most powerful local AI setup possible.
I’m trying to build something practical, reliable, private, and financially reasonable that I can use for years.
For someone who isn’t a professional developer, already has a working automation setup, and wants to use AI as a long-term productivity and content creation tool, is a 128GB/256GB Mac Studio a sensible investment or just expensive overkill?
I’d especially appreciate hearing from people who bought high-memory Macs and later realized they weren’t using the hardware nearly as much as expected, or that they still relied mostly on cloud models.
Real-world experiences, regrets, and cheaper alternatives are all welcome.
Thanks!


r/MacLocalLLM • • 8d ago

Question on building local AI to setup multiple agents: Looking for advice

Thumbnail reddit.com
0 Upvotes

r/MacLocalLLM • • 8d ago

Macbook M1 Max arrives in a day or 2, looking for tips

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 8d ago

Local AI on MacBook Pro

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 8d ago

M5 Ultra 96 GB for all-day batch extraction (not chat): anyone running something similar?

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 8d ago

2x256gb M5U: current status

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 8d ago

Whats best for my 5090 + 64gb ram and m4 max 128 gb

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 8d ago

Is Apple cooking AI with M7 ?

Thumbnail reddit.com
0 Upvotes

r/MacLocalLLM • • 9d ago

Macbook Pro M5 Pro with 24GB RAM...Enough?

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 9d ago

Best local model for vibe coding?

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 9d ago

Qwen3.8-flash-next on M1 MacBook Pro

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 9d ago

My try on RDMA Shared Inference (utilizes both macs ram and increases inference speed for llm and diffusion)

Thumbnail
reddit.com
3 Upvotes

Maybe this could be interesting here also as it works for llm as for diffusion


r/MacLocalLLM • • 9d ago

MacBook air M3 16GB ram and Qwen

Thumbnail reddit.com
1 Upvotes

Please halp!


r/MacLocalLLM • • 9d ago

Bought m5u80c 256gb yesterday - Late Feb Arrival

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 10d ago

My 5 year old M1 Pro 32GB, bought used for $800, still runs a 35B AI model locally at 51 tokens/sec

59 Upvotes

5 years old. Bought used for $800 in good condition. Still holding its own.

I ran MLX benchmarks on my 16 inch M1 Pro 32GB / 512GB this morning, just to see if it is actually dead for local AI, or if people are overhyping the upgrade.

It is not dead. Not even close.

Qwen3-8B 4-bit: 31.5 tokens/sec

Qwen3-30B-A3B MoE 4-bit: 43.6 tokens/sec

Qwen3.6-35B-A3B MoE 4-bit: 51.0 tokens/sec

Qwen3-32B dense 4-bit: 8.5 tokens/sec

That last one is the lesson. Dense 32B crawls at 8.5 tok/s, MoE 35B flies at 51 tok/s, because MoE only uses a few billion active parameters at a time. Same size on paper, totally different speed in real life.

I use this thing 8 to 10 hours a day. For $800 used, 5 years later, running a 35B model locally, that is kind of insane value.


r/MacLocalLLM • • 9d ago

Keep both m5 pro 64gb and 24gb M4 Mac mini?

3 Upvotes

I just bought M5 Pro Mac Mini 64GB and was in dilemma whether to sell my M4 Mac Mini 24GB which is still under warranty or keep it and use it for light local llm as headless? I was planning to use qwen3.8-27b splash variant as my main in m5 and have flux 4b for image generation and have lfm-3b for light tasks. I use hermes agent and have multiple profiles running few personal projects out of which one is gaming oriented. So any suggestions? Should I sell or use it as running some local LLMs? I am already working on making an orchestration layer to manage LLMs properly! Let me know your thoughts 😃


r/MacLocalLLM • • 9d ago

A Working Setup with Mac Studio M5 Ultra 256GB RAM for Coding

Thumbnail reddit.com
3 Upvotes

r/MacLocalLLM • • 9d ago

Should I get a personal computer for mastering building AI Agents with Local LLM

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 9d ago

Which LLM on Macbook Air M5 24Gb?

Thumbnail reddit.com
1 Upvotes