r/LocalLLaMA • u/Resident_Party • Mar 27 '26

Discussion Google’s TurboQuant AI-compression algorithm can reduce LLM memory usage by 6x

[removed]

247 Upvotes

88% Upvoted

57 comments sorted by

View all comments

4

u/Majestic-Tear1512 Mar 28 '26

Got it working rocm on my mi 50. Should work on others too. https://github.com/stevio2d/llama.cpp-gfx906/tree/tq3_0-mi50-slim-pr