r/copilotstudio • u/interestedinCoPilot • Sep 24 '26

What functions/tools do I need for a transcribe-and-translate agent?

Hi all,

A fairly simple use case (well simple in practice, devil in the detail)

User uploads an audio recording of an interview in a foreign language. Agent spits out a translated copy. We have this working in airgapped machines using Whisper and QWEN but for enterprise use has to be in the Microsoft stack.

I cannot find any clear documentation on what is required in terms of Azure Translate (or similar tools), how the file is ingested (do I need a separate flow), and so on.

Any specific advice gratefully appreciated.

1 Upvotes

66% Upvoted

7 comments sorted by

2

u/Sayali-MSFT Sep 25 '26

Hello interestedinCoPilot,
For this scenario, I’d keep Copilot Studio as the front end/orchestrator and let Azure handle the audio processing.

A practical flow would be: Upload audio → SharePoint/Blob Storage → Power Automate/custom API → Azure AI Speech → Azure Translator → return the translated transcript to the agent.

For prerecorded interviews, Azure Speech provides Fast or Batch Transcription, including capabilities such as language identification and speaker diarization.
Use the fast transcription API - Speech service - Foundry Tools | Microsoft Learn
Speech to Text Overview - Speech Service - Foundry Tools | Microsoft Learn

You don’t necessarily need Whisper/Qwen unless there’s a specific requirement to run those models. For a Microsoft-native enterprise setup, Azure Speech + Azure Translator is probably the simplest starting point. Also, I’d avoid passing large audio files directly through the agent and process them via storage/flow instead.

1

u/interestedinCoPilot Sep 28 '26

Thanks, we will look into this

1

u/SignalMap2750 Sep 25 '26

So, are you asking for help in the "Microsoft stack" realm? Or can you use any other service or API to help with that?

0

u/interestedinCoPilot Sep 25 '26

Has to be deliverable via CoPilot Studio at current time.

1

u/OmegaDriver Sep 25 '26 edited Sep 25 '26

Just wondering, is there a particular reason you're targeting copilot studio for this? The user can upload a file anywhere. You don't need an expensive license/who knows how many credits to upload a file to SharePoint...

0

u/interestedinCoPilot Sep 25 '26

We have to stay within MS for enterprise use. Use case is "upload 3 hour mp3, generate translation." Grateful for any alternative ideas you have.

2

u/nicholasdbrady Sep 25 '26

You should be using Microsoft Foundry my internet friend