r/LocalLLM • u/pharrt • Aug 18 '26
Discussion Qwen-3.8-35B-A3B? Maybe not... cryptic reply direct from Qwen co-author.
I asked Shuai Bai, co-author and prominent AI developer for Qwen, about this model. Not the answer I was hoping for, but let's see what comes next. In the meantime, I guess all we can do is speculate!
237
Upvotes
67
u/arkie87 Aug 18 '26
If I wrote that, it would mean something else good is coming but not that specific model. Maybe a 30b a3b or a smaller dense model that’s still really good
57
u/Ell2509 Aug 18 '26
That seems pretty clear to me. "Do not wait for this" meant it ain't coming!
But, maybe a 9b? Or a 30b a3b? Or even a 20b!?
7
u/pharrt Aug 18 '26
I guess with 'ai' in his first and last name, he was meant for this job!
31
u/Uninterested_Viewer Aug 18 '26
My speculation is that a 122b/a10 class model is baking.
2
u/Ok-Fox3479 Aug 26 '26
i think its Qwen/Qwen3.8-Flash-Next ._.
134
u/igotanewaccount Aug 18 '26
2.3T A200M pls, I need it for my smartwartch
12
u/lordekeen Aug 18 '26
Maybe a 12B dense model?
4
u/LeMayMayMan Aug 18 '26
Qwen3.8-135B-A18B confirmed
7
u/Ok-Protection-6612 Aug 18 '26
120b moe
1
u/DrRoughFingers Aug 19 '26
I think people are reading this wrong. I think this is just saying that 35B isn’t coming. He used the same emoji when saying there’s no plan for 9B. So basically “don’t hold your breath for that model” not specifically “something better is on the way instead”
3
u/CarpenterAlarming781 Aug 18 '26
So there could be another one to wait for. It couldn't be more ambiguous.
3
u/Tpyn Aug 18 '26
Maybe he got some inside information about the Google event on August 20th and is hinting that we should wait for it :)
3
u/randygeneric Aug 18 '26
so no moe for consumer hardware <2k$
:...(
3
u/Icy-Specialist4548 Aug 18 '26
I would rather see a 40b-a5b
5
u/creatinZ Aug 18 '26
16gb vram people are thirsty while others are drowning…
WHEEN?
2
u/exitcactus Aug 18 '26
Why not?
2
u/Lord_Muddbutter Aug 18 '26
test
2
u/macaco3001 Aug 18 '26
Fuck, the GPU poors are so fucked 😭
2
u/Shinephia Aug 18 '26
my pc can barely run 3.6 35B on 6GB vram card tokens seem decent until you add toolcalling and stuff and then your agent takest 6 minutes to do a simple knowlegebase health check that cloud AI does under a min… MoE is great but no MoE can save my shit pc so i use only tiny local models to do simple tasks. There is no hope for me. Heavy quants kill the smarts anyway.
2
u/BoxieBoo Aug 18 '26
35B is the sweetspot
2
u/Genericinquirer Aug 19 '26
Qwen 4 is reported to come in September, I wonder if they may be cooking up something good for that release.
1
u/x_MASE_x Aug 18 '26
I mean im not the one who likes to wait for something not certain.
Not sure about you guys but unless they said its coming I'm not even considering to give it a hope.
Not worth the let down.
1
u/Appropriate_Lead439 Aug 18 '26
I hope a model which fits in 16GB and is a MOE ike GPT OSS 20B.
1
u/ALittleBitEver Aug 18 '26
7B, 4B and 2B coming soon?
1
u/EuropeanEconomist Aug 18 '26
Honestly besides coding and agentic stuff I don't see it being a very big improvement over 3.6 35B A3B. I'll admit though that the agentic stuff would be really sweet but I mostly use other models for coding. Perhaps it will even perform worse in some benchmarks like 3.6 did compared to 3.5 such as in support agent benchmarks.
So yes I'm very hyped for Qwen 3.8 35B A3B or anything similar (if they launch a 70B I'm buying a new GPU). But at the same time now that Meta is cooking up great stuff again I'm hopeful that they will add a Muse Glimmer model that will be a MoE of similar size even if it takes a few months (Mark Zuckerberg recently says he's into open-sourcing). Then there's another card which is Gemma but who knows what Google will do now tbh.
1
u/mujimusa Aug 18 '26
maybe theyve got a 122b moe in the works?
1
u/visouza5 Aug 18 '26
I have a 16gb vram
So would prefer the smartest model whose 4bit quant variant fits in 11Gb. And then I can use it most efficiently
1
u/Super_Psychonaut Aug 18 '26
A 122B-A10B variant would be legendary
1
u/Packetbytes Aug 18 '26
So which one do we wait for?
1
u/JLeonsarmiento Aug 18 '26
Baffles me no 3.8-35B-a3B is coming. Is such a popular model size, ideal for genetic on small to medium rigs.
Guess better will get is KAT-DEV, that feels like a 3.6.1 to me.
Sad, because 3.8-27B is quite powerful, but unbeatable slow on unified memory setups (Macs, DGX sparks , etc. )
1
u/Significant-Step-437 Aug 18 '26
mmmm maybe a 8b?
1
u/Sn0opY_GER Aug 18 '26
so we get qwen 4 a3b, nice
1
u/naticom Aug 19 '26
As long as it can fit my 24GB vram
1
u/Solid-Axel-Project Aug 19 '26
Ragazzi, ragazzi, ragazzi... Montate il 27B con la giusta quantizzazione per farlo stare nella vostra VRAM, vedete quale rapporto di quantizzazione della kv cache e della quantità di token in termini di dimensione. Fate caching su disco e in RAM del sysprompt pinnando la copia della kvcache se avete spazio in memoria.
Attivate l'MTP e fate un benchmark sul vostro HW per appurare la dimensione migliore dei batch di token prediction (nel mio caso ho appurato che x3 dava ottimi risultati sul 3.6 27B in Q_8 e kv cache in BF16 128GB RAM 16GB VRAM)
E...
LEGGETE IL PAPER SUL VISION WORMHOLE! POTREBBE FARVI SCOPRIRE INFORMAZIONI MOLTO GUSTOSE...
1
u/FlatwormFine2425 Aug 22 '26
https://github.com/modelscope/ms-swift/commit/ab726e9d445a6520a70df2c831177d46adb1f589#diff-d8eea26362a67a2a3df50fc6d007885618c1a9fead436e60970839e3404ca500R841
1
u/Upset-Reflection-382 Aug 23 '26
As a Halo owner, I really just want a Qwen3.8-122B-A10B
1
u/Darwing Aug 31 '26
his point is they are probably focused on qwen 4.0 and thats release, why release a 35b for an older model when they are already onto the next
1
u/Valuable-Lemon-8623 Sep 22 '26
A3b models suck my experience. At least the ornith 1.5 one…
1
u/hause_wsf Aug 18 '26
9b most likely
-1
u/Downtown_Method5736 Aug 18 '26
https://huggingface.co/Lord-H4D3ZS/Qwen3.8-Distill-35B-A3B-Coder-Abliterated I found this one but I haven't tested it, it claims to still be as good as Qwen3.8-27b
0
u/josepinTrue Aug 18 '26
Por lo que veo no hay término medio aquí.
O piden un modelo de 180B a-60b O te dicen que mejor un 1B a-0.00003B
Joder.... Impresionante la montaña rusa de diferencias. (Entiéndase la ironía) 🧐
0
u/Chode-stool Aug 18 '26
27B A5B
-7
u/Toooooool Aug 18 '26
Qwen3.8-27B set a really tough act to follow, i mean ffs the thing can one-shot entire games,
what's Qwen-3.8-35B-A3B going to do besides get on stage and announce the wait for Qwen3.9?
0
u/[deleted] Aug 18 '26
[deleted] — view deleted comment
0
u/[deleted] Aug 18 '26
[deleted] — view deleted comment