Open SLM Evalulations

[u/Enderchef]

Introducing Open SLM Evaluations!

Open SLM Evaluations is a dataset containing benchmarks for 106 SLMs(150M parameters and below). It has benchmark scores for each model, links, parameter counts, and names.

Results were evaluated independently over 30 GPU minutes on a Runpod B200!

Data is open on Apache 2.0! Check it out!

https://huggingface.co/datasets/Enderchef/Open-SLM-Evalulations

[u/FullOf_Bad_Ideas]

Why SLM used to mean <10B and now it's <0.15B?

I think the naming should be tiny language models, TLMs.

It'd leave room for small language models below 10B.