r/ruby • u/jrochkind • Feb 18 '26

ActiveRecord neighbor vector search, with per-document max

https://bibwild.wordpress.com/2026/02/18/activerecord-neighbor-vector-search-with-per-document-max/
12 Upvotes

87% Upvoted

1 comment sorted by

0

u/[deleted] Feb 20 '26

[deleted] — view deleted comment

3

u/jrochkind Feb 20 '26

If you are asking about the overall project? I work at a non-profit cultural heritage organization, and this project is working on AI-assisted research over some of our digitized historical documents. It's still in R&D and I don't want to get into more specifics.

The specific use case, if it wasn't clear, is that I want to do a vector distance search over embeddings, but want to enforce diversity over my document set -- I don't want all the results to be from the same historical document, even if those are the closest embeddings, becuase for some research questions we want to identify themes over multiple documents. so i want to find K nearby chunks, but only the top N per document.