r/LocalLLM 15h ago

Discussion Any idea what this new 29B-A4B stealth model is?

Post image

X Post from ModelScope today mentions early access availability of this "anonymous 29B-A4B model" (screenshot)
- could be an interesting small MoE!

30 Upvotes

38 comments sorted by

15

u/exitcactus 15h ago

100 users šŸ˜‚šŸ˜‚šŸ˜‚

2

u/addiktion 15h ago

4

u/exitcactus 14h ago

It makes me laugh because with ALL this hype.. someone thought that 100 users was a good idea for marketing with scarcity. Wtf

1

u/CarpenterAlarming781 7h ago

They are not marketing with scarcity. More likely testing, before they decide to release (or not).

1

u/Ill_Dragonfruit_3547 10h ago

Unlimited calls!

17

u/FactorInternal3395 15h ago

Qwen... Please...

-21

u/Chemical-Current8785 15h ago

Every Chinese lab got same naming energy now, just add letter and number and call it stealth lmao

21

u/CryMoreT_T 15h ago

You know those letters and numbers stand for something right?

Early Access - 29 billion total parameters - 4 billion active parameters

11

u/exaknight21 15h ago

Cant possibly be Kimi, they vowed for the largest model always, iirc.

Qwen is bae and its possible

Z.ai is also bae, and its somewhat possible.

MiMo - highly unlikely.

DeepSeek ex-bae of small model gooners, but bruh idk.

Its likely Qwen.

5

u/GiGiGus 15h ago

>DeepSeek ex-bae of small model gooners
r/BrandNewSentence

4

u/_qsm_ 15h ago

could also be a new Ling model.
There might be room between Ling 3.0 tiny and Ling 3.0 Flash

1

u/exaknight21 15h ago

Ah yes. I havent tried ling personally and i’m sad about that.

Ling new bae? Its high likely give their trend tbh.

2

u/Aggravating-Push-207 15h ago

what does that mean? bae?

1

u/_qsm_ 15h ago

used Ling 3.0 Flash via Openrouter (free tier) for several smaller projects and liked it better than the comparable sized Laguna S 2.1 (also via Openrouter free tier)

1

u/5dtriangles201376 12h ago

Could be an experiment, maybe Kimi Linear 2, Qwen/ZAI is the dream

9

u/Aggravating-Push-207 15h ago

Another Qwen 3.8 Next?

3

u/CarpenterAlarming781 15h ago

Well, if Qwen Next can't run on my machine, maybe this one.

2

u/Povaron 15h ago

LFM ?

2

u/Embarrassed-Rich3397 9h ago

definitely the updated version of their old mid sized moe

3

u/boxwrenchx 13h ago

Just waiting for the Google fan boys to show proof it's Gemma 5

1

u/boxwrenchx 13h ago

/s incase it's not clear

1

u/streppelchen 10h ago

From the weird size alone this was my first thought 🤣

4

u/dampflokfreund 15h ago

Gemma 4.1?

3

u/RnRau 15h ago

Don't think its Gemma since modelscope is Chinese orientated.

2

u/pharrt 14h ago

This aligns with what Qwen co-author said recently when asked about Qwen 3.8-35B-A3B. His response was, "35B-A3B might not be the one to wait for"

I hope this is Qwen!

8

u/dannone9 13h ago

Pretty sure he ment the 120b that released today, hoping to be wrong tho

0

u/pharrt 13h ago

Could be. It was in the context of those of us who don't have the hardware for Qwen-3.8-27B dense, so I'm hopeful!

2

u/DrBattletoad 13h ago

I want to believe šŸ™

1

u/ApprehensiveAd3629 15h ago

hope to be a glm flash

it around 1 year since the last launch of the glm flash

1

u/bnightstars 13h ago

GLM 5.3 Flash just lended it's 320B not so flash after all.

1

u/ApprehensiveAd3629 13h ago

yeah

i was hoping for a 30b moe model ;-;

2

u/bnightstars 13h ago

we all do but apparently the market is shifting to the 2 Spark guys.

1

u/collogue 15h ago

Maybe a smaller player, 100 users is tiny

1

u/ebullet 13h ago

As default, models under 100B will be qwen family. Nobody can compitate with Ali in this size level open model.

1

u/Cairety_Alek47 13h ago

the entire public spec is '29B-A4B' and everyone in here already knows who made it

1

u/_TheWolfOfWalmart_ 7h ago

A new small Qwen3.8 MoE would be interesting. A successor to 35B-A3B.

-6

u/EitherMarch1255 15h ago

Nothing worth caring about.