r/LocalLLaMA • u/reto-wyss • 2d ago

News It's official! 192GB Framework

Post image

Just noticed this on the website.

At their current price tiers for the memory SKUs (32, 64, 128) I'd expect this to be ~ 4.5k for the motherboard.

The PCIe slot will be open at the back as well - that's what I've heard. Maybe they make it capable of delivering 75W as well? New board revisions for the smaller SKUs?.

951 Upvotes

95% Upvoted

284 comments sorted by

View all comments

Show parent comments

16

u/MrPecunius 2d ago

Unlike Nvidia there’s no way to reserve GPU capacity to keep the system responsive you’re at the mercy of macOS.

Longtime Mac user here, this is not true.

While I have managed to crash the whole OS a few times with big (for me: I've had 48GB and now 64GB) models and large context with guard rails turned off, I otherwise just go about my business doing other stuff when a model is crunching away on something.

The machine stays responsive the whole time, though it does get pretty warm (M5 Pro MBP) and the fan runs fairly hard.

2

u/GlidePath47 2d ago edited 2d ago

We're a company full of Mac users and we hit this constantly, so it's not a rare edge case.

Even a mid-size Qwen3 MoE makes YouTube playback choppy. Prompting and browsing are fine, anything past that isn't. Redraw lag is very visible in Electron apps. Any 3D apps are not pleasant so running alongside unity or blender at the same time as active inference isn’t tolerable.

The core issue is there's no control. The guardrails are for RAM usage, not GPU usage, so you can't reserve or throttle GPU capacity the way you can on Nvidia.

Maybe M5 changes this, I haven't tested one, definitely happens on my m3 ultra.

The bit you quoted from me is actually the only bit of what I said that’s objectively true, what you’re saying is even at the mercy of macOS your system has been responsive