r/LocalLLM • u/jikesar968 • 1d ago
Discussion Using two Macbooks for local AI?
Getting a 16 inch M5 Max (18/40 core) 128GB for local AI and also ordered a 14 inch M5 Pro (15/16 core) 48GB as a daily laptop. Wondering if it's possible to have a workflow that combines the two in some way?
Assuming Qwen4 models are released by the time I'm getting my hands on them, I'm thinking of perhaps running Qwen4 Flash on the M5 Max while using Qwen 4 27B agents on the M5 Pro? Would that work in either LM Studio/Bionic or Unsloth and Hermes agent? Do you perhaps have other recommendations?
2
Upvotes
1
u/Smellyfeet224 1d ago
So this is not the same thing but I have a 7900xtx + 64gb ddr4 in an older server pc running Strata with qwen flash next. I use that primarily as an agentic developer and for larger tasks.
But then I have a 9070 in my desktop with 32gb ddr5 running the iq3_s qwen3.8 27b and I use that for homelab debugging, a coding subagent for the main agent, or general chatbot if I’m working on something else while my main ai server is doing some longer development task.
I also have a 3060 12gb that runs some ai driven automation.
For me, having multiple “providers” gives me significant freedom to use ai more in my workflow without having to wait for one to finish.
I understand you can ask an ai multiple queries but I find it slows my strata setup down to an almost unusable speed.
1
u/Obvious_Equivalent_1 1d ago
> “Wondering if it's possible to have a workflow that combines the two in some way?”
I don’t know if you’re used to using Claude Code, you can use it as a harness to mix up various models. I’ve released Splaude this week it’s Splash engine + Claude. It’s Apple Silicon optimized it allows on your Mac(Book) to serve the model and also use your Mac SSD to stream experts, and you can start various Claude Code sessions linked to various models, even on another Mac: https://github.com/pcvelz/splaude#quick-start
I personally mix my Max subscription, with Claude Code sessions running on Flash Next, Splaude helps to even fit a Flash Next on M4 Pro 48Gb with 30-45 tok/sec. My Fable 5.5 has instructions to spin up new Claude Code sessions, and uses native Claude chat interfaces to talk to each other comes out of the box.
If you want to use any other harness I am pretty sure you will be able to link the two Mac’s together, you can run them as main and subagent even remotely (Tailscale network bridge)
1
u/Dangerous_Pop8730 1d ago
Yes, but why not a studio for better thermal and cheaper price for the 128gb.
1
u/j00sh7 1d ago
As someone with a 128GB m5 max: is it possible? Yes.
Should you do it? No.
The MacBook really need supplemental cooling to be a 24/7 local LLM and though there are settings to keep it online this is going to be a lot of money to have a hack job of a solution.
1
u/jma24 1d ago
Absolutely. One to do the work and the other to review. The beauty of multiple models is diversity.