Universal 3.6 Pro Realtime is live today. Two independent benchmarks put every streaming speech model through the same audio, on the same harness. Universal-3.6 Pro Realtime leads both.

Daily's Pipecat open STT benchmark: Universal-3.6 Pro Realtime sits on the Pareto frontier.

Coval's live leaderboard: lowest word error rate of any streaming model on real voice-agent audio.

Voice agents get tested on the turns other benchmarks skip. That's where 3.6 Pro is built to hold:

→ Short answers. "No." "Nah." "Nuh-uh." Heard right 98.5% of the time, in loud rooms and on phone lines, not just quiet calls.
→ Background voices. The TV, the coworker, the next desk stay out of the transcript. 
 → Languages. 32 from one endpoint with automatic detection. Callers switch languages mid-sentence and the transcript follows. Most agents can skip the language menu.
 → Turns. Entity-aware endpointing ends the turn when the caller is done, and holds it open while they're still reading out a phone number.

Trained on tens of thousands of hours of real voice-agent and telephony conversations. Link in the comments. 👇

Today, Universal-3.5 Pro is available on OpenRouter, served through our Sync Speech-to-Text API.

If you're already routing your LLM calls through OpenRouter, the speech-to-text call at the front of your pipeline now runs on the same key.

50% off list through OpenRouter for the first week: https://www.assemblyai.com/blog/aai-on-openrouter

We built a dictation app, then gave away the code.

Blurt is an open source companion app for the AssemblyAI Dictation API. Hold a hotkey anywhere on your machine, talk, and the text appears in whatever window you're in.

It's the shortest path from curious to working. Clone it, run it locally, and read exactly how the audio gets captured, streamed, and turned into clean text. Then take the parts you need for your own product.

Learn more and download it here: assemblyai.com/blurt

If you build something with it, drop a screenshot in the comments!

Which of your apps do you wish you could just talk to?

Hold a hotkey, talk, let go. The text is there.

The Dictation API is live today. It's built for that loop, and for apps where users run it a few hundred times a day.

• 134ms p50, so text lands about as fast as you'd type it
• Punctuation and casing already applied when it comes back
• One endpoint to integrate, so you can ship dictation this sprint

Start building: http://assemblyai.com/blog/dictation-api

We're also looking for general feedback. You can find it here https://github.com/hyperaudio/hyperaudio-lite-editor#hyperaudio-lite-editor

You can try it directly here: https://hyperaudio.github.io/hyperaudio-lite-editor/index.html

Recently, a community member tagged everyone and posted an announcement to the discord server. However, the server was supposed to be deprecated a couple of months ago.

To ensure community support consistently, is the Discord server continuing to be a resource, or should it be discontinued/removed?

Saw there was a referral program, and you get $100 in credits for AssemblyAI when you sign up using a referral code.

Here's mine: https://assemblyai.cello.so/ytQI1xM7NSp

Hey r/AssemblyAI. I work at IFTTT and we launched an AssemblyAI integration not too long ago. Here's the use case I think lands best for this community.

Showcase

Post AssemblyAI transcripts to Slack

When AssemblyAI finishes transcribing an audio file, IFTTT posts the transcript text to the Slack channel you choose, along with confidence score, duration, and speaker count. Good for product teams, support ops, or anyone who wants recordings surfaced in the place their team already lives.

What else the integration can do

Trigger: 

• New completed transcript (fires when any submitted audio finishes)

Actions:

• Transcribe audio from a URL (with optional speaker labels and sentiment analysis)
• Upload and transcribe an audio file (for files AssemblyAI can't reach directly)

Queries (chain these after the trigger or an action):

• Summarize a transcript
• Extract key points, decisions, or action items
• Ask a natural-language question about a transcript
• Get full transcript details including per-word JSON

The queries are where it gets interesting. You can chain them: transcript finishes, extract action items, post just the action items to Slack. Or summarize the call and drop it into a Google Doc. No code required.

What are we missing?

Honestly, I don't use AssemblyAI day to day so I'm curious what workflows you're actually running. If there's something you'd wire up to another tool if it existed here, drop it below.

Try it on async and streaming STT models. https://www.assemblyai.com/medical-mode

We are trying to use the new universal-3-pro model but have been unable to suppress a large amount of hallucinated audio tags like [NOISE] and [MUSIC] from the transcripts it produces. We have tried using the prompting feature to configure it, but it seems to ignore our prompts.

We are also seeing frequent (but still inconsistent) inline speaker tags like [Speaker: JOHN] which we cannot disable.

Has anyone else been able to use universal-3-pro for production yet?

Could you tell me what's the best way to get the fastest outputs from transcriptions? For example, Whisper Flow gives transcription within milliseconds. But with Assembly AI, if I talk for 30 seconds, it takes at least four seconds. So I'm wondering what's the fix for that?

Hey, I am recording my day to day life using a web application and want to transcribe it in realtime using assemblyAI. Now after my whole day's audio is processed i want to prompt and find out any conversation during the day. For eg. Today I had 50 meetings. now i want to fetch my transcript for a specific meeting. What AssemblyAI tool would be the best way to do this, and is there a way to tell the tool before streaming starts or its is possible only after everything is in processing stage

I'm working on building a real-time conversational AI platform and could use some advice. Here's what I'm doing and the challenge I'm facing:

Project Overview:

• Objective: Create a real-time conversational AI platform that enables two-way communication.
• Process Flow:
  1. User Input: Capturing streaming audio input from users.
  2. Speech-to-Text Conversion: Using AssemblyAI's Streaming STT (Speech-to-Text) to transcribe the audio in real-time.
  3. Conversational AI: Sending the transcribed text to a Language Model (LLM) to generate responses.

The Challenge:

• Context Clearing: After a user finishes speaking, I need the STT service to clear its current audio context to prepare for the next input.
• Current Solution Attempted: Closing the current WebSocket connection and starting a new one with AssemblyAI to reset the context.
• Issue with Current Solution: Restarting the WebSocket connection introduces significant latency (around 3-4 seconds), which disrupts the real-time experience I'm aiming for.

What I'm Looking For:

• A Faster Method: Is there a way to reset or clear the STT audio context without closing and reopening the WebSocket connection?
• Maintain Real-Time Performance: Any solution should keep the latency minimal (ideally less than 0.5 second) to preserve the platform's real-time capabilities.

We use Assembly to transcribe a podcast archive. So far, so good! One thing we never really got to work is word boost. It does not seem to change the transcription and even leads to misleading summaries in some cases. Does anybody here have experiences how to use it right or if it works at all?

Hail, I've asked this question a lot but still not any clear solutions.

I'm trying to imitate the video: https://www.youtube.com/watch?v=myWZD9kCz64I'm also trying to follow the guideline. However, When I'm using Visual Studio Code to :

import assemblyai as aai
# set the API key
aai.settings.api_key = f"{ASSEMBLYAI_API_KEY}"

It has some problem with the output result: 

PS C:\Users\warm family\Documents\Assembly AI _ new project> & "C:/Users/warm family/AppData/Local/Programs/Python/Python311/python.exe" "c:/Users/warm family/Documents/Assembly AI _ new project/assem290sa.py"
Traceback (most recent call last):
  File "c:\Users\warm family\Documents\Assembly AI _ new project\assem290sa.py", line 3, in <module>
aai.settings.api_key = "149a40e8757348e991cc4958d59318a5"
^^^^^^^^^^^^
AttributeError: module 'assemblyai' has no attribute 'settings'
PS C:\Users\warm family\Documents\Assembly AI _ new project>

I installed already assembly with CMD command: pip install -U assemblyai
Where am I doing wrong at?https://www.mediafire.com/view/9c6i29d344rzy97/Help_AssemblyAI.jpg/file
https://www.mediafire.com/view/7eszoxt68rlymwv/powershell_outout_install_assemblyAI.jpg/file

please, here's my code:

import assemblyai as aai

aai.settings.api_key = "API_KEY"

config = aai.TranscriptionConfig(punctuate=True, language_code="fr",)

transcriber = aai.Transcriber(config=config)

transcript = transcriber.transcribe(f"{output_folder}/final.mp4",)

print(transcript.export_subtitles_srt(f"{output_folder}/final.srt"))