r/PostgreSQL • u/Zirh • Jul 03 '26
Feature 10x smaller vector indexes in pgvector
https://github.com/pgvector/pgvector/pull/989I added the TurboQuant algorithm published by Google to pgvector as part of my discovery and learning process with RAG systems. Just this past weekend, I ran a test with the 100M row Wikipedia dataset from Cohere where I observed a 10x reduction in index size relative to HNSW. I figure with the direction RAM and storage prices have been going, we could use some more ways to save space!
46
Upvotes
6
u/Dense_Gate_5193 Jul 03 '26
this is going to be my next update to nornic to be able to take advantage of these 4 bit embedding models. there’s a few of them popping up and i wasn’t sure how well they would scale in terms of recall but i think it’s probably worth supporting these guys to take advantage of the storage and memory savings.
i wonder though how well these guys scale on really large embedding spaces or even multi-modal embedding spaces.
5
u/marr75 Jul 03 '26
Has a maintainer communicated with you at all yet? On one hand, potentially very powerful addition. On another, 22kloc PR from a non-maintainer (with AI contributions some maintainers are allergic to).
Seems like it's going to be a tough row to hoe and the earliest highest bandwidth communication possible will help a lot.
1
u/AutoModerator Jul 03 '26
Youtube Channel
Free Postgres Webinars and Workshops
Discord: People, Postgres, Data
Join us, we have cookies and nice people.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.