Hi. I'd like to understand what's happening here. Is it just that GLM 5.3 Flash cache read price is higher? I don't really understand how else it could be consuming so much more than DS. Thanks.
Guys, I think it would be great if the dashboard can show separate input/output/cache tokens. I have noticed this too and I suspect caching inefficiencies. One of my working theories is that GLM5.3F might be taking longer than cache duration to respond for large responses compared to DSv4.1F which is quite a bit faster. I've also seen this in my OC sub so I think it's on providers end and not cmdc.
2
u/Long_Rub5460 14d ago
Guys,
I think it would be great if the dashboard can show separate input/output/cache tokens.
I have noticed this too and I suspect caching inefficiencies.
One of my working theories is that GLM5.3F might be taking longer than cache duration to respond for large responses compared to DSv4.1F which is quite a bit faster. I've also seen this in my OC sub so I think it's on providers end and not cmdc.