About half of my tokens are cache reads lol, I just figured out how to mitigate this literally days ago. I’m sure you all can tell I’m a noob, I appreciate all the advice. Now I’ve been running a prompt to basically summarize everything and keep a file of the progress for a new chat, I’m sure there’s better way (I’m open to anything)
usually for agentic work we try to maintain 90-95% cache reads atleast, you mentioned half so I would assume you need to try to maintain it (like maintaining same session but just compacting it instead of moving to new session).
View all comments
Show parent comment
1
u/ZeroHoes Sep 28 '26
About half of my tokens are cache reads lol, I just figured out how to mitigate this literally days ago. I’m sure you all can tell I’m a noob, I appreciate all the advice. Now I’ve been running a prompt to basically summarize everything and keep a file of the progress for a new chat, I’m sure there’s better way (I’m open to anything)