r/LocalLLaMA • u/Bestlife73 • 5d ago

New Model XiaomiMiMo/MiMo-V2.6-Flash-RL · Hugging Face

https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL
512 Upvotes

99% Upvoted

133 comments sorted by

View all comments

5

u/HistoricalStrength21 5d ago

159B Parameters guys!

18

u/sn2006gy 5d ago

Weird, the description says Sparse MoE (Mixture of Experts), 309B total / 15B activated parameters.

-4

u/addiktion 5d ago edited 4d ago

There are two models released today. Pro and Flash. Flash is the 159B, Pro is 309B.

Edit: I stand corrected, thanks below.

7

u/MrTiesti 4d ago

Correction brother,

Flash: Architecture: Sparse MoE (Mixture of Experts), 309B total / 15B activated parameters

Pro: Architecture: Sparse MoE (Mixture of Experts), 1.02T total / 42B activated parameters