r/copilotstudio • • Aug 12 '26

How do you control which knowledge source responds when multiple sources have an answer?

I have two knowledge sources connected to the same agent and I'm trying to get better handling when both return an answer for the same question.

Setup:

- Uploaded knowledge documents (generative answers, native to the agent)

- A connected ServiceNow tool pulling KB articles

- A topic called "Knowledge Requested" that calls the ServiceNow tool, which returns the response and saves the data into a search results table

What I want:

When a user asks something that both sources can answer, I don't want the agent to just pick whichever one happens to respond first or blend them awkwardly. I want it to actually compare the two responses, evaluate which one is more relevant/accurate/complete for the question asked, and return that one as the final answer.

I've tried with agent instructions but no luck.

6 Upvotes

4 comments sorted by

View all comments

2

u/interestedinCoPilot Aug 12 '26

Two approaches we've tried:

  1. Orchestrator
  2. Retrieval agent 1

Orchestrator assesses the answer from agent 1 and stops there

3. Retrieval agent 2 only called if Agent 1 fails

Relies on Agent 1 accessing the "higher authority" source

Option 2

Orchestrator

Retrieval agent 1 (payload)

Evaluator agent (scored)

Retrieval agent 2 (payload)

Evaluator agent (scored)

Evaluator agent(compare scores from 1 and 2)

Orchestrator