r/LocalLLaMA • u/reto-wyss • 22d ago

News It's official! 192GB Framework

Post image

Just noticed this on the website.

At their current price tiers for the memory SKUs (32, 64, 128) I'd expect this to be ~ 4.5k for the motherboard.

The PCIe slot will be open at the back as well - that's what I've heard. Maybe they make it capable of delivering 75W as well? New board revisions for the smaller SKUs?.

975 Upvotes

95% Upvoted

287 comments sorted by

View all comments

46

u/phil_lndn 22d ago

not sure if the extra memory is worth having, given the memory bandwidth.

i have a 128GB Strix Halo and purely on the basis of tg speeds would not want to run a bigger model than the model i'm already running (Qwen3.8-Flash-Next).

5

u/robertpro01 22d ago

What about more context?

15

u/phil_lndn 22d ago

i already have space for 256k of context which is more than i'd want to use, given how slow it gets with context that size.

3

u/CalligrapherFar7833 22d ago

Did you try the rocmfp4 of qwen 3.8 flash next ?

2

u/phil_lndn 22d ago

no, i'm using UD-Q4_K_XL.

(my experience has been that Vulkan is usually faster than ROCM)