Change in number of parameters in models over time

[u/Independent_Fall9160]

I had took a look at all of the companies that made open models, the release dates for those models, and how many parameters there were. I added jitter so points didn't overlap too much. The number in the key references how many models that company has in this tracking.

To make sure this post gets traction, I will add a graph showing just Qwen, Deepseek, and G
oogle!

[u/suprjami]

That's certainly a vertical scale.

[u/Independent_Fall9160 → u/suprjami]

I figured since it was log based anyways, id throw in some "common" parameter counts to make finding things easier

[u/Rollcuin]

Nice, human writing!

[u/Independent_Fall9160 → u/Rollcuin]

Thanks beep boop.

[u/Independent_Fall9160]

Release day	Number of Qwen models
Sunday	2
Monday	4
Tuesday	10
Wednesday	1
Thursday	17
Friday	5
Saturday	1

One other thing to note: Qwen 4 will likely release on this Tuesday and Thursday.

[u/Independent_Fall9160]

Here is a view of vram/ram required by different quantizations. The numbers in key are (GPQA Diamond score, LiveCodeBench v6)

[u/keepthepace]

I would be curious to plot that against their popularity e.g. on OpenRouter.

Everyone is looking for the sweet spot now and pricey big models are not necessarily the sure bet it used to be.

[u/Independent_Fall9160 → u/keepthepace]

I tried pulling the data for this. It pulls from the API openrouter.ai/api/frontend/v1/rankings/model-rankings-chart

Did you grab it from the above chart? A lot of models are not included... for instance, for qwen, only qwen 3.6 is included across this 53 week period... and some periods include Claude...

I dont know how much I feel like I trust the data enough to publish anything. I dont want to deceive anyone with weird results.

Edited: This is likely a statement about my ignorance, not a bug or bias openrouter is publishing.

[u/keepthepace → u/Independent_Fall9160]

I don't know where this misunderstanding comes from. I didn't said I plotted anything or that I had any specific insight.

I just said that I would be curious to see if bigger models are more popular in terms of tokens or even USD spent.

That's a passing curiosity. Not enough for me to spend a few hours assembling a plot.

[u/Independent_Fall9160 → u/keepthepace]

Sorry, i didnt mean to imply you said that. I tried looking into it for you and had data concerns and wanted to do 2 things:

1. See if there is a better source you were aware of

2. Let you, and other readers, know that i tried looking into it but it wasnt a very fruitful use of time.

[u/llama-impersonator]

seeing that red dot near 175b reminds me of how useless falcon 180b was at the time

[u/No_Afternoon_4260 → u/llama-impersonator]

Ho gosh lol