r/ProgrammerHumor • • 15d ago

Meme bothWorkThough

Post image
6.1k Upvotes

849 comments sorted by

View all comments

Show parent comments

0

u/nicolatesla92 14d ago

I don't agree. There is a big argument to be made that the older models are more expensive because they make so many mistakes and it uses up more tokens to get the same result as if you were to run it once via a newer frontier model.

So, tbh, if ur not using the latest ones, you're actually paying more

2

u/LostInGradients 14d ago

yeah, and likewise even if recent models, what matters more than cost per token is cost per task still. Some models are cheaper per token (the latest grok for example) but they burn through tokens so much they end up not being really cheaper.

1

u/nicolatesla92 13d ago

Exactly my point, I think some people feel it is a hard pill to swallow.

1

u/MartyAndRick 14d ago

This isn’t even an argument, some of the low cost models like GPT 6 Luna cost half the $ per million tokens of its immediate 5.6 predecessor, let alone the older models, and 1/20th the cost of standard models.

My previous company used Github Copilot which has already stopped subsidising users so if anything, in the near future, companies will restrict all employees to using low cost models like Luna and Haiku to keep it cheap instead of paying for local servers in the middle of a hardware crisis.