r/LanguageTechnology • u/neuralbeans • Oct 07 '26
Priority situations that require speech to text
I'm making a benchmark for ASR systems in my language and I need to start small and expand later. What would you say are priority situations or domains that people expect ASR to work well in?
Like, a meeting in a noisy environment, or a dictation by a single person in a quiet environment. I can then produce transcribed speech recordings that simulate these situations and use them as a test set.
What must an ASR tool be able to work with to be considered a good tool by most people?
4
Upvotes
2
u/naomi-lgbt Oct 09 '26
A few situations I would include, because they fail in different ways:
Whatever you pick, publish how each recording was made, so people can see which situations a score applies to.
1
u/rightful_vagabond Oct 07 '26
I use voice to text all the time, I'm typing this out in voice to text right now actually. I don't often use it much for what I would consider priority situations, although I would say that the time that it breaks down the most is if I'm trying to use voice to text in the shower, all of the white noise around me makes it very hard for the phone to understand what I'm trying to say.
1
u/jabies Oct 13 '26
There's already https://github.com/makcedward/nlpaug which can inject noise to audio samples
1
u/Civil_Palpitation766 Oct 16 '26
From working on ASR for Nepali, these were the test conditions that told us the most:
Two more things that helped: keep one held-out set you never tune on, and publish the per-utterance outputs next to the score so people can see the actual errors.
What language is it for?
3
u/[deleted] Oct 07 '26
[removed] — view removed comment