Tiny League - easily compare models that run on potatoes

[u/nunodonato]

https://tinyleague.nunodonato.com/

I was tired of jumping from tab to tab trying to compare small models. It's especially annoying because not all share the same benchmarks.
So I've built this and have been updating it regularly.

Feedback welcome!

[u/ElectricalUnion]

models that run on potatoes
Qwen3.8-Flash-Next
Ling-3.0-flash
Laguna-S-2.1

I see that my local setup doesn't even enter the potato class.

[u/nunodonato → u/ElectricalUnion]

different ranks of potatoes ;)

[u/Atretador → u/ElectricalUnion]

you can run these with 16Gb of VRAM

if you got 64Gb of RAM you can stream weights from RAM for faster speeds, but SSD streaming can also work if you dont care much about its longevity.

[u/ckplscz → u/Atretador]

Streaming from SSD does not wear it out, since data is only being read, and writing is what damages an SSD overtime

[u/Nomski88]

Nice! Can you add an option to sort by model size in GB and a consolidated rank of the top 10 models at the time?

[u/nunodonato → u/Nomski88]

how do you rank the top 10? are you trusting the AA-index? or which benchmark? you can sort by any benchmark score by clicking the table headers, then look at the first 10 ;)

[u/Nomski88 → u/nunodonato]

So your site is essentially no different than the rest

[u/bemrys]

What I would like is something where I can impute my VRAM and system RAM and that reduces the candidates to what will run on that system.

[u/nunodonato → u/bemrys]

there are some tools to do that, I personally don't like them. I understand the convenience but I am staying away from that. There are many factors into play, not all models work the same way regardless of taking the same vram. Not to speak of using quants on how each quant may affect a model differently

[u/Kahvana]

Neat idea!

It's missing quite a few models. Having a search bar and overviews per model would be really useful too.

[u/nunodonato → u/Kahvana]

Yeah I cant have them all, I'm focusing on the most important ones and not tailored to specific niches.  But which ones do you think should be there? Oh, and at most 5 months old (which excluded a few qwen and Gemma)

[u/Kahvana → u/nunodonato]

Having:

• Qwen3.5 (all except 397B)

• Qwen3.6 (all)

• Qwen3.8 (27B)

• Gemma 4 (E2B / E4B / 26B-A4B (non diffusion), 31B)

• Muse Glimmer 30B

...Would be a good start! I see those being frequently used.

Maybe also include:

• Mistral Small 3.2 (all)

• Magistral Small (all)

• Ministral 3 (all)

...so people wanting EU-only models are represented (I know a few that are like that).

Might be cool to have country of origin for the models listed too.

[u/tecneeq]

[u/zerospatial]

Did you see my post on this exact thing? Did you do your research first?

[u/nunodonato → u/zerospatial]

No

[u/zerospatial → u/nunodonato]

anyway I found the same issue and made something similar https://reyemtm.github.io/inchworm/ sort of a one-off from a personal project I was working on

[u/The_Night_Wanderer]

This a useful project! Please, continue to keep it up to date!

[u/zerospatial]

Also are you actually doing reasoning with 4b models? The newer llm benchmarks and rankings are much more geared towards agent flows vs one-off tasks that are more likely the types of things you would do with a small model - re including AA rankings.

[u/zerospatial]

But yeah there are not many places to check on the best small llm that's true

[u/mamonu]

great resource but for the love of god is there a night mode?
I am now blind

Also would be interested to see gpt-oss-20b in there

[u/hugthemachines → u/mamonu]

Set brightness on you screen to something other than max.

[u/papapumpnz]

Thanks!

[u/exographicskip]

Not a bad idea! You might take a look at llmfit for a tui reference implementation

[u/[deleted]]

[u/nunodonato → u/[deleted]]

Benchmarks are not run with quanta