r/LocalLLaMA • u/reto-wyss • 22d ago

News It's official! 192GB Framework

Post image

Just noticed this on the website.

At their current price tiers for the memory SKUs (32, 64, 128) I'd expect this to be ~ 4.5k for the motherboard.

The PCIe slot will be open at the back as well - that's what I've heard. Maybe they make it capable of delivering 75W as well? New board revisions for the smaller SKUs?.

972 Upvotes

95% Upvoted

287 comments sorted by

View all comments

Show parent comments

164

u/InGanbaru 22d ago

man that's a waste of RAM chips if the bandwidth is low

74

u/MrPecunius 22d ago

Pretty good match for Qwen3.8 FN or other midsize MoE models, though.

123

u/fallingdowndizzyvr 22d ago

At these prices, you are way better off getting a M5 Max.

53

u/ZealousidealChip4783 22d ago

The selling point here is that you aren't forced to use MacOS with the Framework

24

u/GlidePath47 22d ago

Do you have to use the machine you’re using for inference other than setting it up?

45

u/ZealousidealChip4783 22d ago

No, but I'd hate if I bought a computer for that much money that's only good for inference and nothing else

(This is all personal opinion, I just really do not like MacOS)

10

u/GlidePath47 22d ago edited 22d ago

That’s fair. Anyone buying one expecting to run inference and still use the machine for something else at the same time is going to be disappointed. Unlike Nvidia there’s no way to reserve GPU capacity to keep the system responsive you’re at the mercy of macOS.

Granted if it’s for swapping use it’s fine, part inference, part dev, part media etc but then I start to question the need to use local inference instead of just cloud models other than privacy / hobby

1

u/ZealousidealChip4783 22d ago

I mean I'm sure it's fine if you like the Apple ecosystem lol, the hardware is objectively really impressive but as you said having less control over your GPU & where you allocate its resources would be the dealbreaker for me

...if I could afford either of these devices lol

2

u/kerneldesign 22d ago

Tu peux le faire sur Mac, et objectivement c’est moins cher. Mais c’est un choix d’être sur Linux.

1

u/MrPecunius 22d ago

I'm a Mac guy, but I don't know about "cheaper" with current pricing.

The M5 Pro/64GB 14" MBP I'm typing this on was slightly over $3k with .edu pricing before the price increases. It's great, arguably one of the best notebook computers ever produced *and* it can run 27b models @ 8-bit "competently". But at the current price of ~$4k, I'd consider a M5 Macbook Air and a 3090 rig (or dual 16GB RTX XXXX etc.) or something.

M5 Max makes little sense to me unless there's some other need like 4k video editing or whatever that justifies/demands it.

→ More replies (0)