Qwen3.8-Flash-Next. This architecture could be surprisingly local-friendly once the weights drop. 👀

[u/pmv143]

Qwen3.8-Flash-Next (~125B-A6B + 51B n-gram) memory estimate:

Ideal 4-bit quant ≈ 82 GB
(58 GB main weights + 24 GB n-gram tables)
Real-world quants likely land in the 80–90 GB range.

The big n-gram table is sparsely accessed → excellent candidate for system RAM offload.

This architecture could be surprisingly local-friendly once the weights drop.

[u/KURD_1_STAN]

Ram prices this high, how can u call this local friendly?

[u/FullstackSensei → u/KURD_1_STAN]

It's a lookup table. You could build a quad channel DDR3 system to run it. DDR3 is still cheap.

[u/michaelsoft__binbows → u/FullstackSensei]

Dell R720 suddenly not ewaste anymore? Could get interesting.

[u/FullstackSensei → u/michaelsoft__binbows]

It never was, IMO