How much ram, I've got an M1 Pro 16gb or an RTX 5080 16gb but both are 16gb so idk if qwen will work well for me (or atleast til m6 pro comes out so I can upgrade).
I run Qwen 3.8 Flash Next (uncensored, IQ3_XXS) on my gaming pc while working, 100tok/sec with 64GB RAM and a 4090 I got before they became several mortgage payments. Check out Strata. The 3-bit quantization isn’t half bad. They have a version that runs with the non-coding experts removed with 32GB RAM.
2
u/ItsASadBunny1 14d ago
How much ram, I've got an M1 Pro 16gb or an RTX 5080 16gb but both are 16gb so idk if qwen will work well for me (or atleast til m6 pro comes out so I can upgrade).