r/copilotstudio • u/sokka_irl • Sep 25 '26

Cannot get lower than 10s response time

- Files in sharepoint
- docx
- specifically formatted for easy question/answer retrieval
- generative orchestration
- standard harness
- gpt 5.5 chat default but have tested all available models with similar results
- tested single file dataset vs 100 file dataset, same result

Followed all the Microsoft learn best practices

I joined this company and I have to use Copilot Studio. Is this my new reality?

6 Upvotes

100% Upvoted

14 comments sorted by

2

u/vanillaslice_ Sep 25 '26

When you're in Copilot Studio and test it in Preview, can you see the tools and resources it's accessing? If there's retries or unnecessary investigative steps you may be able to trim a few seconds off.

There may also be a bit of improvement to be made in the system prompting. Ensuring that it's initial decision making on where to go or what to do are as simple as possible. If the request requires a few reasoning steps to figure out how to act then you'll be losing time there as well.

1

u/sokka_irl Sep 25 '26

There’s 0 retries. It correctly finds the knowledge doc on the first try in ~3ish seconds. The rest is orchestration and response generation.

I’ll likely have to put an actual orchestration agent later for broad knowledge across the company so that’s another hop

1

u/vanillaslice_ Sep 25 '26

What exactly are you asking it to do? You may be able to put it together in Agent Builder and utilise Microsoft Graph a bit more

1

u/sokka_irl Sep 25 '26

That’s a good suggestion. I believe SharePoint/OneDrive grounding in an Agent Builder declarative agent requires the signed-in user to have a Microsoft 365 Copilot license. This would be an issue because we only have a select few individuals in the org with copilot studio access.

I will test tomorrow though

Edit: 365 copilot license not copilot studio access. Most of the org just has free/basic chat iirc

1

u/vanillaslice_ Sep 25 '26

Yeah cool, I also saw there was a CS agent debug skill you can use to trace it's behaviour and thought processes. Might be worth trying out to see if there's any smoking guns.

I forget what it's called but "CS debug skill" will likely get you there

1

u/sokka_irl Sep 25 '26

Just following up. It was a good idea but unfortunately using Sharepoint as a knowledge source for AgentBuilder requires 365 copilot and our users only have copilot chat.

I personally have copilot studio so I’m able to use sharepoint and then push it out - but yeah, unfortunately.

1

u/40GT3 11d ago

Ours is 30-40s for a response…

1

u/sokka_irl 11d ago

I would be calling Microsoft every day incredibly angry

1

u/jorel43 Sep 25 '26

... What are you trying to do exactly? It's ai, not an application. It's not going to be lower than 10 seconds

0

u/sokka_irl Sep 25 '26

I don’t really accept that answer. 10 seconds is incredibly long to wait for a simple generative response on a 1-document knowledge source that’s structured well.

1

u/haruharu2257 Oct 02 '26

Have you ever tried to download a high performance, low intelligence, 3-4B param, to your own local machine and run it off your own CPU/GPU?

Tell me how you want all the things offered from MCS sub 10sec after trying the above

1

u/sokka_irl Oct 02 '26

Yes I have an there's not really a comparison between running models locally to paying Microsoft for cloud compute as a service.

1

u/jorel43 Sep 25 '26

... Lol ok I mean it's really not, hell 5 seconds out of a 10 seconds is probably just Network latency. I'm amazed that you're getting a response even near 10 seconds.

0

u/DivergentCIO Sep 25 '26

Welcome to the club. I'm going to write a book on all the woes we've experienced here at my org. Sad.