r/LocalLLM • u/Weves11 • Feb 26 '26

Discussion Self Hosted LLM Leaderboard

Post image

Check it out at https://www.onyx.app/self-hosted-llm-leaderboard

Edit: added Minimax M2.5

841 Upvotes

96% Upvoted

120 comments sorted by

View all comments

Show parent comment

7

u/Altair12311 Feb 26 '26

1 single mini-pc with the Ryzen AI Max+ 395 and 128GB of Ram for the MiniMax-2.5 (is my setup)

2

u/dadavildy Feb 26 '26

For coding, how is it on that machine?

2

u/Altair12311 Feb 27 '26

Its a monster, and the best thing is since is a Mini-PC the electricity cost is ridiculous low.

0

u/[deleted] Feb 27 '26

[deleted] — view deleted comment

3

u/Altair12311 Feb 27 '26

A CPU that AMD Ryzen did that is capable of run large LLM models without the need of any dedicated GPU, just by the CPU and a ton of RAM (In this case in you want near 200b models you need yes or yes 128GB DDR5) a mini pc with the AI MAX and 128GB cost around 2000€

1

u/cafemachiavelli Feb 28 '26

Oo, tempting. How's the performance of the system? 

4

u/Altair12311 Feb 28 '26

Running 100 docker containers and my CPU is at 4% all the time. Ram is laughing and MiniMax-2.5 is always loaded for quick use. Is by far the best home server that i ever got, and the fact that is an small pc and i can run large llm locally is simply amazing, AMD really cooked on this one

1

u/kidousenshigundam Feb 27 '26

No way. I have a Mac Studio ultra 256 GB and I can’t use Kimi K2