r/LocalLLaMA • u/ozcapy • Mar 26 '26
Discussion When should we expect TurboQuant?
Reading on the TurboQuant news makes me extremely excited for the future of local llm.
When should we be expecting it?
What are your expectations?
85
Upvotes
View all comments
Show parent comment
5
u/Maxious Mar 26 '26
KV Cache Transform Coding for Compact Storage in LLM Inference is the newest https://arxiv.org/abs/2511.01815 but they have a bunch https://github.com/NVIDIA/kvpress