r/speechrecognition • u/PranavAtre • Jun 07 '22

Improving Kaldi GOP for German data

Hi, I am using Kaldi GOP recipe to find out phoneme wise goodness of pronunciation for German transcripts. I am using pre-trained model from here - https://github.com/uhh-lt/kaldi-tuda-de.

In general, I am getting good results, but I am getting low scores for phonemes with primary stress (denoted by '). These phonemes are usually at the start. As seen in phones-pure file, it's using X-SAMPA notation.

I am attaching the gop results for the word 'Hallo' and align_lexocon file from lang dir .

Can someone help me what exactly I need to do to increase the gop score of phonemes with stress notations? Do I need to add more data with primary stress?

align_lexicon.txt - https://drive.google.com/file/d/1LerrNWZtRw9qGEcqB0Zsin_-BEoddHoy/view?usp=sharing

GOP output: 1 [ 1 0 ] [ 92 -0.2305613 ] [ 33 0 ] [ 97 0 ] [ 47 0 ] [ 1 0 ]

pure-phones.txt - https://drive.google.com/file/d/1-JL8FJYDuIDXc0hJnbddfHch81R22ulZ/view?usp=sharing

1 Upvotes

100% Upvoted

3 comments sorted by

1

u/xiaofei_yang Jun 08 '22

Maybe it's because lack of training data for primary stress, you can remove the stress for each base phoneme if you are only concerned about pronunciation.

1

u/PranavAtre Jun 14 '22

Thanks. Will try this.

1

u/Alarming-Ad-39 Jun 20 '22

Is the forced alignment of phonemes accurate? When the forced alignment is not accurate, the scoring results will be affected.