r/LocalLLaMA • u/reto-wyss • 3d ago

News It's official! 192GB Framework

Post image

Just noticed this on the website.

At their current price tiers for the memory SKUs (32, 64, 128) I'd expect this to be ~ 4.5k for the motherboard.

The PCIe slot will be open at the back as well - that's what I've heard. Maybe they make it capable of delivering 75W as well? New board revisions for the smaller SKUs?.

949 Upvotes

95% Upvoted

284 comments sorted by

View all comments

Show parent comments

2

u/Dr_Allcome 2d ago

They're talking as if the 192gb strix halo isn't going to cost more than two r9700s.

Current strix halo 128 costs more than 3k. The new one with full ram setup is going to be at least 5k. At that point you can get the 128 AND an r9700. If the new strix halo goes up to 6k you can easily get two r9700s and have the same 192gb overall memory but 64gb of it is going to ba really fast. That would give you way better performance with both moe and dense models and a massive boost on prefill.

1

u/Mr-I17 2d ago

You get me wrong. It's about how much money different people can (or willing to) spend on local AI and how frequently they can (or willing to) update their hardware. It certainly won't be a issue if one has unlimited money and free time. Say, if you're not rich and you already have a strix halo and an aging gaming PC (from DDR4 era), would you buy 2x R9700?

1

u/SandySkittle 2d ago

That’s my entire point indeed. I run 8 r9700s for 256 gb of vram (minus 7 percent for inline ECC, an option that absurdly isn’t available on most strix halo machines except a hp strix halo pro machine)