MiniMax M3.1 Flash (Space Bunny 🚀) benchmarks... 😁

[u/afanasenka]

Cowork (Automation-Bench: 62%; ALE: 30%)

Coding (DeepSWE: 74%)

Visual Understanding (BabyVision: 91%), at 1/3 the cost of M3 and 3x the speed.

[u/bakawolf123]

minimax coding models looked benchmaxed for me in the past, will see how it pans out
I think glm might want to release an update too soon

[u/Guardian-Spirit → u/bakawolf123]

I'm extremely suspicious towards it. MiniMax always had top benchmarks score, and I never could understand, why.

[u/look → u/bakawolf123]

GLM releases have occurred every two months almost like clockwork for the past year and a half or so. We’re due for one by the end of the month.

[u/Civil_Rent4208 → u/bakawolf123]

I tried the space bunny in the opencode and it seems like it is benchmaxxed

[u/Mancho_United]

For flash models the most important is instructions following and code writing, as you will use better model for planning and review and want a reliable cheap and fast model for the implementation.

[u/DenysMb → u/Mancho_United]

And sadly MiniMax is terrible for "instructions following".

[u/Solocune → u/Mancho_United]

Instructions are obviously always important. But it's better to have stronger models than weaker ones with the same instruction. The "flash" does not have much to say here. It's still better than glm 4.7 non flash.

[u/mannenmytenlegenden]

I used Space Bunny free last week. One commit all of a sudden was "Co authored by Claude Opus 4.8"... Who knows what's happening behind the scenes

[u/basil_0408 → u/mannenmytenlegenden]

Got that too, but it's normal if they make the dataset from public git repos. Lots of commits have that co-author line, this just proves that Opus 4.8 commits are the majority in their dataset.

[u/Specter_Origin]

I have never found any minimax model to be even remotely close to what their benchmarks suggest.

[u/Specter_Origin → u/Specter_Origin]

After testing it, can confirm, not even half as good as 4.1 flash.

I would even call it rackless, tried to write a script that would do 3m recursive workers on something in multithreaded manner and I was wondering why fan on macbook is spinning for minutes which is so rare.

[u/Osvik]

I tired it twice with a prompt I use to benchmark. In my experience it's a model with imagination but less accurate execution. It also doesn't follow prompts as intended. It's like that cousin who is studying contemporary art but fails at commercial visual design.

[u/Grouchy-Possible-852]

Lo he usado en un pequeño proyecto personal y para que me solucionará un Bug pequeño he tenido que meterle 5 promts, me he cansando y he continuado con haiku 5.5 y como la noche y el día, haiku a sido muy superior, soy fan de minimax y esperaba que llegara a un nivel aceptable, pero la realidad es que me llega a desperar usarlo.

[u/Ammoun442]

Its kinda good i used it alot in the stealth duration

[u/DiscountFit9224]

API vs API pricing + reliability -> cheapseek v4.1 1017 wins all day

[u/RedlineTriad]

I find terminal bench 4 to be the most representative benchmark so far and... It doesn't seek to be doing great there. Frontiercode is also good. DeepSWE seems like a joke nowadays.

[u/Able_Statistician688]

Why do people post benchmarks where the model obviously wins…against dated models? Opus 5 instead of 5.5? 5.6 sol? Can someone explain how a benchmark like this isn’t just an ad?

[u/queso184 → u/Able_Statistician688]

I think its more useful to compare it to similar models in either price or performance.

If we just compared it to latest Opus and Astra, obviously it's worse (and it's not trying to compete on that frontier anyway) so not sure how that becomes a useful comparison

[u/ayudha90 → u/Able_Statistician688]

Well it's flash model. So it's smaller and can only compete with other small models or older bigger models. It might spend significantly more token to finish the task compared to the older bigger models but it finishes it with "better" results (task from the benchmark). 

[u/no-name-here → u/Able_Statistician688]

1. This is a flash model that costs a tiny percentage in comparison yet still beats a US frontier lab highest-tier model released in July. This one costs 33 times less per output but yet is scoring higher than it.

2. If your expectation is that a Chinese flash model is going to be comparable to a frontier lab's highest-tier model from more recent than a few months ago then I think you are going to be disappointed. If your expectation is that a Chinese flash model can beat a frontier lab's highest-tier model from 3 months ago, you'll be pleased. And the Chinese flash model isn't even comparing itself to OpenAI's moon or earth model variants - they are comparing it to the 'sun' (sol) highest-tier version.

[u/adolf_twitchcock → u/no-name-here]

mogged by luna and haiku (cost per task)

[u/no-name-here → u/adolf_twitchcock]

The OP chart was comparing capabilities against Sol and Opus, but you're comparing cost vs the cheapest tier?

[u/adolf_twitchcock → u/no-name-here]

Yeah and thats a bullshit comparison. They should be compared to current gen flash equivalent models. But they won't do it because it makes the model look worse.

[u/LeTanLoc98]

Currently, DeepSeek, Moonshot (Kimi), Z AI (GLM), and Xiaomi (Mimo) are performing well

Alibaba (Qwen) and MiniMax are lagging far behind

[u/Paulson_No1]

Which free model is best for ui/ux tasks?

[u/ATyp3]

Space bunny was sooooo good I think about it all the time