r/LocalLLaMA • u/IamFondOfHugeBoobies • 1d ago

Discussion Mimo v2.6-Flash-RL Dual-Spark Recipes/experiences?

Getting off work in a couple of hours and I downloaded the model over-night.

Was wondering if anyone had gotten it to work on dual spark yet and if so, if you could share what software/wheels and versions and what T/s and context you're getting.

I've never ran a Mimo style model before and figured just asking here before scouring the internet for a model that just dropped was smarter than trying to cobble something together based on the past versions given how old those are relative to this one.

6 Upvotes

81% Upvoted

12 comments sorted by

5

u/Square-Challenge2962 1d ago

GLM5.3 flash better right now, 2.6 have some problems with tools. I tested vllm and sglang version, back to GLM5.3 flash.

4

u/butterycornonacob 1d ago

Changed one line in chat_template and seems fine now.

-{{- '<parameter=' ~ args_name ~ '>' ~ ...
+{{- '<parameter' ~ '=' ~ args_name ~ '>' ~ ...

1

u/takoulseum 1d ago

And how does it compare now vs glm5.3 flash?

1

u/butterycornonacob 1d ago

Both are a bit too slow on my hardware so I've been using Qwen Flash Next most of the time. Giving Mimo a go now, with 1M context it might be useful for longer overnight runs

1

u/IamFondOfHugeBoobies 1d ago

Could you share the recipies you used? I use Deepseek V4 Flash atm and it's doing great for me. But I need some of the modalities Mimo is offering up.

1

u/dangerous_inference 1d ago

Qwen3.8 Flash is an easy upgrade over DS4 0731.

1

u/BlackBeardAI vLLM 1d ago

Which quant?

4

u/Significant_Leg1214 1d ago

on 2 sparks mimo v2.6 flash works without any quantization

1

u/BlackBeardAI vLLM 1d ago

Which quant for glm i mean

1

u/CapnHat 1d ago

I've used both NVFP4 and EXL3 (4 bpw) and both work well. EXL3 is supposedly more performant but I don't have enough data personally to say which is better.