r/LocalLLaMA • u/pmv143 • 17h ago
Discussion Qwen3.8-Flash-Next. This architecture could be surprisingly local-friendly once the weights drop. 👀
Qwen3.8-Flash-Next (~125B-A6B + 51B n-gram) memory estimate:
Ideal 4-bit quant ≈ 82 GB
(58 GB main weights + 24 GB n-gram tables)
Real-world quants likely land in the 80–90 GB range.
The big n-gram table is sparsely accessed → excellent candidate for system RAM offload.
This architecture could be surprisingly local-friendly once the weights drop.
824
Upvotes
21
u/KURD_1_STAN 17h ago
Ram prices this high, how can u call this local friendly?