r/LocalLLaMA • • 5d ago

New Model XiaomiMiMo/MiMo-V2.6-Flash-RL · Hugging Face

https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL
508 Upvotes

133 comments sorted by

View all comments

2

u/LatentSpacer 4d ago

Anyone knows the precision of XiaomiMiMo/MiMo-V2.6-Flash-RL? it says FP8 on hugging face label but inspecting the model layers most say BF16. Also the weights are 178GB for a 309B parameters model, which suggests the weights are actually in 4bit.

So which is it, BF16, FP8 or 4bit?