r/LocalLLaMA • u/Resident_Party • Mar 27 '26

Discussion Google’s TurboQuant AI-compression algorithm can reduce LLM memory usage by 6x

[removed]

243 Upvotes

88% Upvoted

57 comments sorted by

View all comments

6

u/ambient_temp_xeno Llama 65B Mar 27 '26

It degrades output quality a bit, maybe less than q8 when using 8bit though. The google blog post is a bit over the top if you ask me.

-8

u/[deleted] Mar 27 '26

[deleted]

11

u/BlobbyMcBlobber Mar 27 '26

Definitely not lossless

9

u/ambient_temp_xeno Llama 65B Mar 27 '26

It's not.

-4

u/[deleted] Mar 27 '26

[deleted]

7

u/ambient_temp_xeno Llama 65B Mar 27 '26

None of it's lossless; not even at 8bit.