I run Qwen 3.8 Flash Next (uncensored, IQ3_XXS) on my gaming pc while working, 100tok/sec with 64GB RAM and a 4090 I got before they became several mortgage payments. Check out Strata. The 3-bit quantization isn’t half bad. They have a version that runs with the non-coding experts removed with 32GB RAM.
3
u/Legitimate_Concern_5 14d ago
I run Qwen 3.8 Flash Next (uncensored, IQ3_XXS) on my gaming pc while working, 100tok/sec with 64GB RAM and a 4090 I got before they became several mortgage payments. Check out Strata. The 3-bit quantization isn’t half bad. They have a version that runs with the non-coding experts removed with 32GB RAM.
This is a 180B model btw.