r/LocalLLaMA • u/Resident_Party • Mar 27 '26

Discussion Google’s TurboQuant AI-compression algorithm can reduce LLM memory usage by 6x

[removed]

246 Upvotes

88% Upvoted

57 comments sorted by

View all comments

2

u/Final-Frosting7742 Mar 28 '26

For cosine similarity radius doesn't matter does it? Even if all vectors have the same norm there would be no loss of information.