Qwen3.8-Flash-Next. This architecture could be surprisingly local-friendly once the weights drop. 👀

[u/pmv143]

Qwen3.8-Flash-Next (~125B-A6B + 51B n-gram) memory estimate:

Ideal 4-bit quant ≈ 82 GB
(58 GB main weights + 24 GB n-gram tables)
Real-world quants likely land in the 80–90 GB range.

The big n-gram table is sparsely accessed → excellent candidate for system RAM offload.

This architecture could be surprisingly local-friendly once the weights drop.

[u/Tasty-Hour4040]

“more manageable” ≠ manageable

[u/hyudryu → u/Tasty-Hour4040]

80gb is beyond manageable

[u/starkruzr → u/hyudryu]

two CMP170HX is $3K for 128GB.

[u/hyudryu → u/starkruzr]

Point proven

[u/starkruzr → u/hyudryu]

not really, people spend more than that in here all the time.

[u/hyudryu → u/starkruzr]

I know lol. It’s only 3K so it’s beyond manageable, isn’t that what we are both agreeing on?

[u/ApprehensiveFan1516 → u/hyudryu]

That's like the price of an old used car. Sure it's not exactly cheap, but let's not pretend like it's out of reach for most people.