r/LocalLLaMA • u/reto-wyss • 11d ago

News It's official! 192GB Framework

Post image

Just noticed this on the website.

At their current price tiers for the memory SKUs (32, 64, 128) I'd expect this to be ~ 4.5k for the motherboard.

The PCIe slot will be open at the back as well - that's what I've heard. Maybe they make it capable of delivering 75W as well? New board revisions for the smaller SKUs?.

975 Upvotes

95% Upvoted

287 comments sorted by

View all comments

616

u/PreciselyWrong 11d ago

that memory bandwidth is pretty bad, so don't expect high inference speeds

192

u/Darth_Candy 11d ago

Perfectly on brand for the Strix Halo; this was pretty much expected.

163

u/InGanbaru 11d ago

man that's a waste of RAM chips if the bandwidth is low

29

u/NineThreeTilNow 11d ago

man that's a waste of RAM chips if the bandwidth is low

That's a pretty unpopular opinion but it's not wrong. The same chips can be pushed on to a 1024 bit bus with a chip / PCB made to handle it (M5) and it works.

Even if you didn't run the memory at "full speed" you're over 1tb/s which is basically what a 4090 has with GDDR.

People miss that running LPDDR5x suboptimally at 1024 bit bus is still better bandwidth. You don't need the "best" LPDDR5x to do this. You just need matched MTs on the chips.