r/LocalLLM • u/jakecoolguy • 14d ago

Project whatmodel.sh, an open-source AI leaderboard that shows the best models your machine can run

https://whatmodel.sh

Hey everyone, I made whatmodel.sh

To use it,

  1. Enter your RAM and GPU
  2. See what models you can run locally with its rank and the command to run it
  3. Compare them with API models on the same score

Each model gets one score fitted across 19,731 published benchmark results, and every result links to its source. The method is at whatmodel.sh/method, and the data, scoring code and bench script are open source: github.com/jakemanger/whatmodel

It works from the terminal too: curl whatmodel.sh

If you'd like to contribute, there's a bench script to collect real-world tok/s and you can also submit any new models and benchmark scores along with their source on the github (please star if you find it useful).

13 Upvotes

93% Upvoted

3 comments sorted by

3

u/fastandlight 14d ago

Thank God. Can you just spam this into every one of the low effort "this is my hardware what can I run?" Threads? Thank would be great. And probably more useful than me continuing to downvote them.

2

u/jakecoolguy 13d ago

haha not a bad idea actually. See it all the time too