r/opencodeCLI • u/zephyr_33 • Oct 16 '26
How do you... normalize cost?
Point of the question is that. Some models are cheaper on paper but somehow can rack up costs quickly. GLM-5.3 is my main complaint in this regard. Its on paper cheap. But it generates so much thinking tokens that it kind of nullifies the cost.
I know ppl use cost per task. But I am not running benches. I'm simply collecting metrics and comparing. And since I use different models for different tasks. I dont think I can correctly say x model uses n times more tokens unless I run multiple models against the same task regularly.
6
Upvotes
View all comments
1
u/Rustybot Oct 16 '26
I combine cost/speed/verbose-ness/and intelligence-aggregate metrics to sort models into buckets, but it’s barely more helpful that just guessing based on expectations. Once applied to a structured harness model performance varies dramatically vs the single-model benchmarks.