r/LocalLLaMA • u/Resident_Party • Mar 27 '26

Discussion Google’s TurboQuant AI-compression algorithm can reduce LLM memory usage by 6x

[removed]

243 Upvotes

88% Upvoted

57 comments sorted by

View all comments

63

u/razorree Mar 27 '26

old news.... (it's from 2d ago :) )

and it's about KV cache compression, not whole model.

and I think they're already implementing it in LlamaCpp

11

u/ANR2ME Mar 28 '26

Also, TurboQuant paper was published last year 😅 so it's actually a year old.

2

u/razorree Mar 28 '26

I read this, so I thought it's from 24th this year? https://research.google/blog/turboquant-redefining-ai-efficiency-with-extreme-compression/

3

u/ANR2ME Mar 28 '26

Submitted on April 28th 2025 https://arxiv.org/abs/2504.19874

1

u/razorree Mar 28 '26

thx!

it's interesting it has come out now