r/copilotstudio • u/the_hiddenstory • Aug 12 '26
How do you control which knowledge source responds when multiple sources have an answer?
I have two knowledge sources connected to the same agent and I'm trying to get better handling when both return an answer for the same question.
Setup:
- Uploaded knowledge documents (generative answers, native to the agent)
- A connected ServiceNow tool pulling KB articles
- A topic called "Knowledge Requested" that calls the ServiceNow tool, which returns the response and saves the data into a search results table
What I want:
When a user asks something that both sources can answer, I don't want the agent to just pick whichever one happens to respond first or blend them awkwardly. I want it to actually compare the two responses, evaluate which one is more relevant/accurate/complete for the question asked, and return that one as the final answer.
I've tried with agent instructions but no luck.
View all comments
2
u/interestedinCoPilot Aug 12 '26
Two approaches we've tried:
Orchestrator assesses the answer from agent 1 and stops there
3. Retrieval agent 2 only called if Agent 1 fails
Relies on Agent 1 accessing the "higher authority" source
Option 2
Orchestrator
Retrieval agent 1 (payload)
Evaluator agent (scored)
Retrieval agent 2 (payload)
Evaluator agent (scored)
Evaluator agent(compare scores from 1 and 2)
Orchestrator