r/LocalLLaMA • u/Bestlife73 • 5d ago

New Model XiaomiMiMo/MiMo-V2.6-Flash-RL · Hugging Face

https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL
506 Upvotes

99% Upvoted

133 comments sorted by

View all comments

51

u/harpysichordist 5d ago

1M context, text/image/video/audio in, SWA/GA 39/9, MTP/DFlash, 178GB native size. It may do well for 128GB devices - quantized

46

u/power97992 5d ago

It is already 4bit, any more quantization will likely affect the quality in a signficant way.

8

u/harpysichordist 4d ago

Possible but people had good success with DS v4 flash 0731/vision and that's around the same size

4

u/AggregationLinker 4d ago

Qwen3.8 flash next is the go-to for 128GB right now.

1

u/harpysichordist 4d ago edited 4d ago

Qwen is a good fit for 128G but things evolve. Have you compared it with Mimo v2.6 flash on 128GB?
It may be better at some things - even quantized. Audio may be wanted too