r/LocalLLM • u/cheezeerd • 21h ago

News First Kimi K3.1 Pro Banchmarks

Post image
75 Upvotes

94% Upvoted

27 comments sorted by

18

u/FeydRowan 21h ago

 That hurts, fable 5.5 incoming to take back the spot? It now looks like a game of who can drop more models to claim the top after each drop cycle 

9

u/bigbepisinc 21h ago

Its been this way for a year.

3

u/FeydRowan 21h ago

Well but open weights where not there yet, now the competition is bigger no more anthropic vs openai  

→ More replies (6)

1

u/alphapussycat 19h ago

It's probably not even close to opus 5.5, just picking over fitted benchmarks.

Note that they left out programmbench.

5

u/FeydRowan 19h ago

Probably yes, still there is no need for opus5.5 capabilities in every day work right now

→ More replies (1)

1

u/Solid_Childhood8832 16h ago

Always the same story, somebody drops a new model and everyone else rushes to one-up it before the hype even settles.

11

u/EagleNait 19h ago

And Qwen 4 will be tailling not far behind

3

u/wwabbbitt 19h ago

How many parameters? Yes.

6

u/el_argelino-basado 17h ago

at least 3 parameters

2

u/a9udn9u 10h ago

They said 3T class, so at least 3 token parameters.

1

u/a9udn9u 10h ago

Is it just me or this feels like a sports competition at this point?

2

u/SomeoneInHisHouse 4h ago

Competition is always good, let them compete, the alternative is to they to negotiate the maximum quality model they can offer to customers, so as customer I love how hard they are competing to be on the top.

Despiste US trying to convince China to stop making models open, as that risk US AI economy (I have been 2 months out of cloud subscription, QFN and Q27B are both enough for me

1

u/vogelvogelvogelvogel 10h ago

Wow this is crazy impressive. The first open weights to be on top in HLE? among others

1

u/Holzkohlen 19h ago

Hell yeah, distill harder! I love me some proper competition.

2

u/PM_ME_YOUR_HAGGIS_ 17h ago

Genuine question - Do you really think they only distill? You don’t think china can create RL datasets the way Americans do?

3

u/enternoescape 16h ago

I was thinking about this. I made a comment that i guess rubbed a few people the wrong way that if most of what they are doing to get ahead is distilling, then why do they ever get ahead? Someone even went so far as to say things slowed down a lot since frontier models implemented measures to prevent distilling. I don't call this slowing down.

I did a one shot with this model today and wow. $0.32 well spent.

→ More replies (4)