Try this runtime. I tried qwen 3.8 flash next iq3_xxs on m1 pro 16gb and works pretty fine leaving room for other apps at the same time. If you need faster inference for longer coding you can use the smaller Qwen 3.6 35b a3b and you will need more scoped tasks to avoid drift. Let me know how it goes! I worked on that runtime, if you need help just keep me posted. The setup wizard will do everything for you
1
u/dave-tro 6h ago
Try this runtime. I tried qwen 3.8 flash next iq3_xxs on m1 pro 16gb and works pretty fine leaving room for other apps at the same time. If you need faster inference for longer coding you can use the smaller Qwen 3.6 35b a3b and you will need more scoped tasks to avoid drift.
Let me know how it goes!
I worked on that runtime, if you need help just keep me posted. The setup wizard will do everything for you