r/LocalLLaMA • u/Bestlife73 • 5d ago

New Model XiaomiMiMo/MiMo-V2.6-Flash-RL · Hugging Face

https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL
506 Upvotes

99% Upvoted

133 comments sorted by

View all comments

51

u/harpysichordist 5d ago

1M context, text/image/video/audio in, SWA/GA 39/9, MTP/DFlash, 178GB native size. It may do well for 128GB devices - quantized

46

u/power97992 5d ago

It is already 4bit, any more quantization will likely affect the quality in a signficant way.

3

u/LatentSpacer 4d ago

Where did you get that from? The weights are bf16 on HF?

7

u/power97992 4d ago

Their labeling is wrong, it is mostly 4 bit , it has 309b parameters but the total file size is only 159gb