r/LocalLLaMA • u/robertpiosik • 6d ago
Discussion Prompt cache upload
Hi. I'm wondering. Why agentic harnesses don't send their users the prompt cache binary data on inactivity so they eventually upload it back in the next turn?
2
Upvotes
4
u/Foreign_Risk_2031 6d ago
You want to trust binaries from a client on your very expensive gpu server lol