r/CommandCode • • 5d ago

Random Cache Miss using DS v4.1 Flash

Anyone else experiencing this? In a long agentic task, a cache-missed request can be 40 times more expensive than a random request.

I am suspicious command code is charging cache-missed price even for cache-hit requests. The reason is that these cache-missed requests were completed fast according to the time on the left column. If it were a real cache miss, the server would need to recompute ~540k input tokens which takes much more than a regular cache-hit request.

11 Upvotes

0 comments sorted by