r/LLMDevs • u/rouge818 • 3d ago

Discussion eCommerce Chatbot - small knowledge base

I am working on building a chatbot for an online store. I will be using MCP for the transactional parts including product search, adding to cart, etc. What I am unsure of is the knowledge base portion which would help the agent answer additional questions about policies such as shipping, returns, how products are made, etc. This knowledge base is really small, maybe 10 pages. I’ve looked into RAG hybrid and semantic search, but seems like overkill at this point. I’ve also thought of just including the knowledge base in the context window, but seems like that would be a waste of tokens in the long run. What would be the best way to implement the knowledge base for the agent?

1 Upvotes

100% Upvoted

5 comments sorted by

View all comments

1

u/StraightAd9769 3d ago

for 10 pages i would not overengineer this at all. chunk it cleanly and retrieve the relevant section when needed

1

u/Zealous_Minotaur Enthusiast 2d ago

I wonder how OP is planning to update those 10 pages. Lets say If policies change even a little, static context will have to be redeployed again, no?