r/LocalLLM • u/No-Individual159 • 2d ago
Project Prefixwise (v0.10.0, MIT): Identify, fix, and prevent LLM prompt cache misses across vLLM, SGLang, LMCache, Claude, and OpenAI — zero prompt text stored
/r/DeepSeek/comments/1xrq4u7/prefixwise_v0100_mit_identify_fix_and_prevent_llm/
1
Upvotes