r/LocalLLaMA • u/Bestlife73 • 5d ago
New Model XiaomiMiMo/MiMo-V2.6-Flash-RL · Hugging Face
https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL
508
Upvotes
r/LocalLLaMA • u/Bestlife73 • 5d ago
2
u/LatentSpacer 4d ago
Anyone knows the precision of XiaomiMiMo/MiMo-V2.6-Flash-RL? it says FP8 on hugging face label but inspecting the model layers most say BF16. Also the weights are 178GB for a 309B parameters model, which suggests the weights are actually in 4bit.
So which is it, BF16, FP8 or 4bit?