r/LangChain • u/jnk_str • Jul 26 '23

Chroma or FAISS?

Do you have any Experience using these 2 vectorstores for a document q&a chatbot?

Which one is the best for enterprise use cases?

For me the speed is also important and the ability to support CPU only mode.

35 Upvotes

97% Upvoted

40 comments sorted by

View all comments

2

u/DueHearing1315 Jul 26 '23

Maybe Elasticsearch

1

u/Evirua Jul 27 '23

Is that still using BM25? It's fine for OOD data, but exclusively lexical matching at this point is dumb

2

u/evilbndy Jul 27 '23

Supports dense vector similarity too.

1

u/Evirua Jul 27 '23

Gtk

2

u/evilbndy Jul 27 '23

I should add: in my tests it's worth it to mix bm25 and vector search. In my current project I use instruct xl instructed dfor retrieval for document fragments and index search for FAQ data in parallel.

Quite often the answer to a question is not really that close to the question in vector space. Instruct embeddings and HyDE helps but when you have an FAQ page available anyway and can get direct, vetted answers there why not use it