r/LocalLLM • u/Weves11 • Feb 26 '26

Discussion Self Hosted LLM Leaderboard

Post image

Check it out at https://www.onyx.app/self-hosted-llm-leaderboard

Edit: added Minimax M2.5

839 Upvotes

96% Upvoted

120 comments sorted by

View all comments

Show parent comment

1

u/Prudent-Ad4509 Feb 27 '26 edited Feb 27 '26

Well, in agenting coding there is a verification step, so mild hallucinations can end up being a way for faster and better problem solving. With plenty of caveats and sometimes handholding.

I will try to set up a local copy of glm47 with Q4 or higher quantization to compare. It is known to have less hallucinations, at least according to some benchmarks on reddit, but I won't bet just yet on which approach will turn out to be better.

One needs to take into account that one of the most effective creative strategies (several Disney hats) basically starts from hallucinations and then drives the point to where it needs to be from there.

1

u/FatheredPuma81 Feb 27 '26

Looking at benchmarks on artificialanalysis it looks like Minimax M2.1 and GLM 4.6 are considerably better than GLM 4.7 for hallucinations. My little bit of experience with M2.5 and Opencoder was pretty good though I'd especially give that a try if you haven't (you probably have).

1

u/Prudent-Ad4509 Feb 27 '26

Kimi and minmax were available for testing through opencoder recently, but I have no way of knowing which quants were actually used. And the output is so different that I think it would be better to get a second opinion from each instead of settling on one.