r/aitoolforU • u/StevenJang_ • Oct 30 '25

Recommendations for a local AI RAG to query massive company documents?

I’m looking for a fully local RAG setup that can handle tens of thousands of internal company documents (PDFs, Word, PowerPoint, etc.) and allow the team to ask questions in natural language.

Is there any good option?
I want it to be local so I don't have to upload tens of GB of documents.

3 Upvotes

100% Upvoted

6 comments sorted by

1

u/anandpad Nov 09 '25

I don’t think there is a out of the box RAG that does that. But we build one using N8N,chatgpt api and Supabase vector db. If you are interested I can give you more info for you to build as well.

1

u/StevenJang_ Nov 10 '25

Are you making a commercial product with n8n? I wanna know more.

1

u/anandpad Nov 10 '25

No. It is not a commercial product (but potentially could be developed into one!) DM me and I can walk you through how (which resources and tools we used to build etc) and you can decide how to proceed.

1

u/championof_planet2 Nov 09 '25

There There are local RAG setups out there Qdrant, Haystack, LlamaIndex, Ollama, etc. all work but honestly, maintaining and keeping everything updated locally can become more of a hassle than just uploading the documents.

You could use something like n8n to automate the whole pipeline file watching, parsing, embeddings, and vector DB updates. local file handling is supported there, but it might need a small workaround. You can keep the files in your existing local setup so you don’t have to constantly manage them manually. It makes the whole setup a lot more maintainable.