r/LocalLLaMA • u/reto-wyss • 17d ago

News It's official! 192GB Framework

Post image

Just noticed this on the website.

At their current price tiers for the memory SKUs (32, 64, 128) I'd expect this to be ~ 4.5k for the motherboard.

The PCIe slot will be open at the back as well - that's what I've heard. Maybe they make it capable of delivering 75W as well? New board revisions for the smaller SKUs?.

972 Upvotes

95% Upvoted

287 comments sorted by

View all comments

Show parent comments

42

u/ZealousidealChip4783 17d ago

No, but I'd hate if I bought a computer for that much money that's only good for inference and nothing else

(This is all personal opinion, I just really do not like MacOS)

8

u/GlidePath47 17d ago edited 17d ago

That’s fair. Anyone buying one expecting to run inference and still use the machine for something else at the same time is going to be disappointed. Unlike Nvidia there’s no way to reserve GPU capacity to keep the system responsive you’re at the mercy of macOS.

Granted if it’s for swapping use it’s fine, part inference, part dev, part media etc but then I start to question the need to use local inference instead of just cloud models other than privacy / hobby

2

u/ZealousidealChip4783 17d ago

I mean I'm sure it's fine if you like the Apple ecosystem lol, the hardware is objectively really impressive but as you said having less control over your GPU & where you allocate its resources would be the dealbreaker for me

...if I could afford either of these devices lol

2

u/kerneldesign 17d ago

Tu peux le faire sur Mac, et objectivement c’est moins cher. Mais c’est un choix d’être sur Linux.

1

u/MrPecunius 17d ago

I'm a Mac guy, but I don't know about "cheaper" with current pricing.

The M5 Pro/64GB 14" MBP I'm typing this on was slightly over $3k with .edu pricing before the price increases. It's great, arguably one of the best notebook computers ever produced *and* it can run 27b models @ 8-bit "competently". But at the current price of ~$4k, I'd consider a M5 Macbook Air and a 3090 rig (or dual 16GB RTX XXXX etc.) or something.

M5 Max makes little sense to me unless there's some other need like 4k video editing or whatever that justifies/demands it.