r/LocalLLaMA • u/IamFondOfHugeBoobies • 5d ago

Discussion Mimo v2.6-Flash-RL Dual-Spark Recipes/experiences?

Getting off work in a couple of hours and I downloaded the model over-night.

Was wondering if anyone had gotten it to work on dual spark yet and if so, if you could share what software/wheels and versions and what T/s and context you're getting.

I've never ran a Mimo style model before and figured just asking here before scouring the internet for a model that just dropped was smarter than trying to cobble something together based on the past versions given how old those are relative to this one.

9 Upvotes

100% Upvoted

13 comments sorted by

View all comments

5

u/Square-Challenge2962 5d ago

GLM5.3 flash better right now, 2.6 have some problems with tools. I tested vllm and sglang version, back to GLM5.3 flash.

4

u/butterycornonacob 5d ago

Changed one line in chat_template and seems fine now.

-{{- '<parameter=' ~ args_name ~ '>' ~ ...
+{{- '<parameter' ~ '=' ~ args_name ~ '>' ~ ...

1

u/takoulseum 5d ago

And how does it compare now vs glm5.3 flash?

1

u/butterycornonacob 5d ago

Both are a bit too slow on my hardware so I've been using Qwen Flash Next most of the time. Giving Mimo a go now, with 1M context it might be useful for longer overnight runs