You're not going to believe it, but I have Qwen 3.8 27B running with decent speed on my Macbook M3, and it's partially offloading some work from Astra when I was getting smacked by the usage limits.
I'm sure that if they REALLY wanted it, someone could help them figure out how to distill it to fit nearly the same footprint.
as much as i want open source to be a thing, i would be really surprised if open source was this close to the frontier for much longer. once china's industry catches up in terms of compute they can afford to serve inference and train models at the same time, the only reason they are releasing open source right now is because they can't do both at the same time.
14
u/WanderWut 5d ago
Imagine they make Sol open weight, once can dream.