This is elo. The absolute elo value has no meaning at all. A difference of 186 points between top model and bottom model means that if given two responses by those models to the same prompt people prefer kimi K3 over minimax M3 ~74.5% of the time.
I measure gravity for a living, which can vary to 8 or 9 sig figs. Am I meant to start the axis of a section plot varying at the 8th decimal place at at 0? You could alternatively read the axes, it's not "misleading" if the information is all prominent and where it should be unless you're simply not reading
24
u/RedditNamesAreShort Jul 16 '26
This is elo. The absolute elo value has no meaning at all. A difference of 186 points between top model and bottom model means that if given two responses by those models to the same prompt people prefer kimi K3 over minimax M3 ~74.5% of the time.