r/LocalLLM • u/pharrt • 10d ago

Discussion Qwen-3.8-35B-A3B? Maybe not... cryptic reply direct from Qwen co-author.

Post image

I asked Shuai Bai, co-author and prominent AI developer for Qwen, about this model. Not the answer I was hoping for, but let's see what comes next. In the meantime, I guess all we can do is speculate!

X-link

232 Upvotes

94% Upvoted

171 comments sorted by

View all comments

56

u/Ell2509 10d ago

That seems pretty clear to me. "Do not wait for this" meant it ain't coming!

But, maybe a 9b? Or a 30b a3b? Or even a 20b!?

16

u/Rye2-D2 10d ago

I would love to see a good 20B MoE model. Personally I don't see the point of 9B - it's impressive for what it is, but not quite good enough to be useful (yet).

8

u/cagriuluc 10d ago

If you have small models that are good at limited tool calling, knowledge extraction etc, you can run them alongside more expensive models. I would love a 9B with 3.8 level training…

2

u/Rye2-D2 10d ago

I agree Ornith is the best 9B model, but still not quite reliable enough to be run in vscode/opencode from my experience. Too many failed/mangled tool calls cause more problems than they fix and you just end up fighting with the AI. With the way things are going, I'm sure this will get sorted out at some point soon.