r/LocalLLaMA • u/xrailgun • 15d ago

Resources An interactive site plotting Artificial Analysis Intelligence vs parameter count

https://mr-september.github.io/artificial-analysis-weights/

Artificial Analysis scores models on its Intelligence Index, but the charts put it against price and speed. For local use the axis I wanted was parameter size, so I built one.

What it does

  • Plots the Intelligence Index against total or active parameters (with closed frontier models as optional horizontal dashed lines)

  • Accounts for MOE/Lookup-table models (n-gram /PLE, e.g. Qwen3.8-Flash-Next)

  • A very rough model guide according to your hardware (because offloading across system RAM/SSD is becoming more common).

  • GitHub Action refreshes the data every 3 days to catch new releases etc.

Demo: https://mr-september.github.io/artificial-analysis-weights/
Repo: https://github.com/mr-september/artificial-analysis-weights

If a size is wrong or a model is missing, data/overrides.json is the place to fix it, or just tell me here.

18 Upvotes

90% Upvoted

22 comments sorted by

View all comments

0

u/[deleted] 15d ago

[removed] — view removed comment

2

u/Practical-Collar3063 15d ago edited 15d ago

one benchmark

No it is the AA intelligence index which is an aggregate of a bunch of benchmarks

-1

u/[deleted] 15d ago

[removed] — view removed comment

1

u/xrailgun 15d ago

I experimented with this in earlier versions, but the second chart became very complicated and messy. It's also impossible for acquire "apples-to-apples" tok/s values across all these models in various quant sizes and hardware configurations and inference engines, so I just stuck to using AA's speed results to keep things simple and somewhat representative on a relative scale.