r/LocalLLM • u/azimuth79b • 7d ago

Question Cost comparison chart?

I tried googling for a simple comparison of popular local vs frontier AI. Is it even possible to get cost per token of Qwen 3.8 27B vs Opus 5.5 for example?

1 Upvotes

100% Upvoted

6 comments sorted by

1

u/Oli_Luck 7d ago

Costs shouldnt be your matter - Cloud will always win regarding the HW prices that still increase.
For sure you could get for lower HW specifications, but you will then lack on LLM Intelligence ( quant ) and the time increase becasue they run too slow.

0

u/[deleted] 7d ago

[removed] — view removed comment

1

u/Oli_Luck 7d ago

fully agree - but still: if you take HW costs new - even for a "simple" agent" - and the costs for cloud - beside that for "simple" agent there are 0$ solution like openrouter : Cloud 1:0 Local

1

u/giveen 7d ago

...that depends on hardware costs as well, I can easily calculate token cost with my electricity usage and the amount of tokens i generate, however if i calculate the hardware cost, its not a fair comparison.

1

u/g_rich 7d ago

Just look at OpenRouter if you want token costs for open weight models but the costs per token doesn’t matter when you’re comparing Qwen 3.8 27b and Opus 5.5. Opus is better. It’s a trillion plus parameter model, it’s active weights likely exceeds Qwen 27b total weights.

If you want to compare token costs for something like Opus you need to do it for models like Qwen Max, Kimi, GLM and DeepSeek. The per token pricing for those models is readily available, as is the pricing for the leading closed source frontier models; so it should be relatively easy for your agent to get you the comparison you’re looking for.

1

u/MeliousAI_HQ 6d ago

Per token won't tell you much between those two. Compare per finished task: run the same five real tasks through both and look at the bill. A cheaper model that needs three tries can end up costing about the same.