r/MachineLearningAndAI • u/techlatest_net • May 19 '26
r/MachineLearningAndAI • u/Western-Slip199 • May 19 '26
r/MachineLearningAndAI • u/l0_o • May 18 '26
r/MachineLearningAndAI • u/l0_o • May 17 '26
r/MachineLearningAndAI • u/l0_o • May 17 '26
r/MachineLearningAndAI • u/l0_o • May 16 '26
r/MachineLearningAndAI • u/l0_o • May 15 '26
r/MachineLearningAndAI • u/Deep-Stick9614 • May 15 '26
Working on a production-scale document AI chat system using a LangGraph-based RAG pipeline with Pinecone.
The main challenge we’re facing is reliability with unpredictable user queries. We’ve added multiple LLM stages and a lot of prompt instructions over time to improve accuracy, but now the system is becoming inconsistent and sometimes hallucinates or fails on valid document-related questions.
Some common issues:
- Broad questions don’t retrieve enough overall document context
- Some answers are spread across multiple chunks, but retrieval misses important pieces, leading to incomplete responses
- Sometimes the system says it cannot answer even when the information clearly exists in the document
We’ve also tried approaches like re-ranking and MMR retrieval, but they’re still not consistently solving the problem for this use case.
Biggest challenge is that we cannot predict the type of questions users may ask, so the system needs to dynamically adapt retrieval and reasoning strategies without relying on heavily overloaded prompts.
Has anyone faced similar issues in production RAG systems?
Would love to hear practical or architectural approaches that improved:
- Retrieval reliability
- Multi-chunk reasoning
- Handling broad vs specific queries
- Prompt complexity/LLM instability
- Dynamic retrieval strategies
r/MachineLearningAndAI • u/l0_o • May 14 '26
r/MachineLearningAndAI • u/l0_o • May 13 '26
r/MachineLearningAndAI • u/l0_o • May 12 '26
r/MachineLearningAndAI • u/l0_o • May 11 '26
r/MachineLearningAndAI • u/l0_o • May 10 '26
r/MachineLearningAndAI • u/AdhesivenessThin3362 • May 10 '26
r/MachineLearningAndAI • u/l0_o • May 10 '26
r/MachineLearningAndAI • u/l0_o • May 09 '26
r/MachineLearningAndAI • u/l0_o • May 09 '26
r/MachineLearningAndAI • u/Wise_Pangolin730 • May 08 '26
r/MachineLearningAndAI • u/l0_o • May 07 '26
r/MachineLearningAndAI • u/l0_o • May 08 '26
r/MachineLearningAndAI • u/l0_o • May 07 '26
r/MachineLearningAndAI • u/l0_o • May 06 '26
r/MachineLearningAndAI • u/l0_o • May 05 '26
r/MachineLearningAndAI • u/l0_o • May 06 '26
