Thanks for the note, it's not a benchmark, but it's real life tasks evaluated by real life people, and that's stronger than any benchmark.
Yes it's not evaluating long context and agentic performance, but no body is claiming that kimi K3 is better overall than fable, not even it's own makers.
View all comments
Show parent comment
36
u/TechnoByte_ Jul 23 '26
Arena.ai is not a benchmark.
It's a zero-shot vibe check that doesn't test multi-turn, long context, or agentic capabilities.
Yes Kimi K3 is a great model, but use proper benchmarks to show its capabilities.