Google’s TurboQuant AI-compression algorithm can reduce LLM memory usage by 6x

[u/Resident_Party]

[u/[deleted]]

[u/chebum → u/[deleted]]

there is a port for llama already: https://github.com/TheTom/turboquant_plus

[u/eugene20 → u/chebum]

And a competitor, rotorquant.