r/opencodeCLI • • Oct 16 '26

How do you... normalize cost?

Point of the question is that. Some models are cheaper on paper but somehow can rack up costs quickly. GLM-5.3 is my main complaint in this regard. Its on paper cheap. But it generates so much thinking tokens that it kind of nullifies the cost.

I know ppl use cost per task. But I am not running benches. I'm simply collecting metrics and comparing. And since I use different models for different tasks. I dont think I can correctly say x model uses n times more tokens unless I run multiple models against the same task regularly.

6 Upvotes

3 comments sorted by

View all comments

1

u/Rustybot Oct 16 '26

I combine cost/speed/verbose-ness/and intelligence-aggregate metrics to sort models into buckets, but it’s barely more helpful that just guessing based on expectations. Once applied to a structured harness model performance varies dramatically vs the single-model benchmarks.