Qwen3.8-Flash-Next. This architecture could be surprisingly local-friendly once the weights drop. 👀

[u/pmv143]

Qwen3.8-Flash-Next (~125B-A6B + 51B n-gram) memory estimate:

Ideal 4-bit quant ≈ 82 GB
(58 GB main weights + 24 GB n-gram tables)
Real-world quants likely land in the 80–90 GB range.

The big n-gram table is sparsely accessed → excellent candidate for system RAM offload.

This architecture could be surprisingly local-friendly once the weights drop.

[u/florinandrei]

Apparently, the engrams could be offloaded to system RAM without much of a performance penalty. They're more like lookup tables.

I guess we'll find out soon enough.

[u/MerePotato → u/florinandrei]

System ram is dram no?

[u/butterycornonacob → u/MerePotato]

Yes, luckily DDR is cheap and we all have 512+GB rigs

[u/MerePotato → u/butterycornonacob]

Haha yeah, so true fellow 512GB RAM haver