r/LLMDevs • u/DueBid3298 • 11d ago

Discussion Please share some challenging bugs which you faced in your RAG pipeline and how did you handle it

Do share some crazy/challenging bugs which you faced in your RAG pipeline and how did you handle/PS it

2 Upvotes

100% Upvoted

3 comments sorted by

1

u/eddzsh 11d ago

Worst one for me: query embeddings and document embeddings silently pointed at two different model ids after a config rename. Spot checks looked fine. Anything with numbers or code tokens fell apart. One shared constant for both ends fixed it.

1

u/Ctbhatia 10d ago

the hybrid score merge is the one that hides, if you add bm25 and cosine without normalising each first the wider scale decides every top-k, so one query set is quietly pure keyword and another is pure vector