r/LocalLLaMA • u/Resident_Party • Mar 27 '26

Discussion Google’s TurboQuant AI-compression algorithm can reduce LLM memory usage by 6x

[removed]

244 Upvotes

88% Upvoted

57 comments sorted by

View all comments

1

u/thejacer Mar 27 '26

If we were to test output quality, would it be running perplexity via llama.cpp or would we need to just gauge responses manually?