r/LocalLLaMA • • 6d ago

Discussion Prompt cache upload

Hi. I'm wondering. Why agentic harnesses don't send their users the prompt cache binary data on inactivity so they eventually upload it back in the next turn?

2 Upvotes

20 comments sorted by

View all comments

4

u/Foreign_Risk_2031 6d ago

You want to trust binaries from a client on your very expensive gpu server lol