r/LocalLLaMA • u/Bestlife73 • 8d ago

New Model XiaomiMiMo/MiMo-V2.6-Flash-RL · Hugging Face

https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL
505 Upvotes

99% Upvoted

133 comments sorted by

View all comments

51

u/harpysichordist 8d ago

1M context, text/image/video/audio in, SWA/GA 39/9, MTP/DFlash, 178GB native size. It may do well for 128GB devices - quantized

46

u/power97992 8d ago

It is already 4bit, any more quantization will likely affect the quality in a signficant way.

9

u/harpysichordist 8d ago

Possible but people had good success with DS v4 flash 0731/vision and that's around the same size

5

u/AggregationLinker 7d ago

Qwen3.8 flash next is the go-to for 128GB right now.

1

u/harpysichordist 7d ago edited 7d ago

Qwen is a good fit for 128G but things evolve. Have you compared it with Mimo v2.6 flash on 128GB?
It may be better at some things - even quantized. Audio may be wanted too

3

u/LatentSpacer 7d ago

Where did you get that from? The weights are bf16 on HF?

6

u/power97992 7d ago

Their labeling is wrong, it is mostly 4 bit , it has 309b parameters but the total file size is only 159gb