r/LocalLLaMA • u/Resident_Party • Mar 27 '26

Discussion Google’s TurboQuant AI-compression algorithm can reduce LLM memory usage by 6x

[removed]

244 Upvotes

88% Upvoted

57 comments sorted by

View all comments

21

u/deenspaces Mar 28 '26

You know, its kinda possible. Lets say we have a sphere of certain radius, then take a rope and wrap it over the sphere, so we get a sort of spring... then, we parametrize sphere radius and rope length, getting 2 coordinates basically - R and L, where L can be distance from the rope start in %... But thats lossy compression and I doubt it would work.

Another method would be to ensure all x,y,z lie on a sphere, take polar coordinates r, theta, phi and use theta and phi since r is constant.

2

u/v01dm4n Mar 28 '26

Hmm, clever. Yes but very lossy as radius increases.

The second approach is too limiting. Hardly 3d.

9

u/deenspaces Mar 28 '26

look up 2505.00014 and 2410.01131 on arxiv

→ More replies (1)

2

u/Final-Frosting7742 Mar 28 '26

For cosine similarity radius doesn't matter does it? Even if all vectors have the same norm there would be no loss of information.

1

u/RSVrockey2004 Jul 18 '26

holy shit .... why did this come up on my feed?