amirabaskohi / automatic-speech-recognition-for-speech-assessment-of-persian-preschool-children

Preschool evaluation is crucial because it gives teachers and parents influential knowledge about children's growth and development. The COVID-19 pandemic has highlighted the necessity of online assessment for preschool children. One of the areas that should be tested is their ability to speak. Employing an Automatic Speech Recognition (ASR) system would not help since they are pre-trained on voices that differ from children's in terms of frequency and amplitude. Because most of these are pre-trained with data in a specific range of amplitude, their objectives do not make them ready for voices in different amplitudes. To overcome this issue, we added a new objective to the masking objective of the Wav2Vec 2.0 model called Random Frequency Pitch (RFP). In addition, we used our newly introduced dataset to fine-tune our model for Meaningless Words (MW) and Rapid Automatic Naming (RAN) tests. Using masking in concatenation with RFP outperforms the masking objective of Wav2Vec 2.0 by reaching a Word Error Rate (WER) of 1.35. Our new approach reaches a WER of 6.45 on the Persian section of the CommonVoice dataset. Furthermore, our novel methodology produces positive outcomes in zero- and few-shot scenarios.

Hi there 👋

🌐amirabaskohi.github.io

🎓Google Scholar

automatic-speech-recognition-for-speech-assessment-of-persian-preschool-children's Issues

Replication of wav2vec2 with RFP

First of all, congratulation on the paper and the scores you achieved!

We would like to replicate the Wav2vec2.0 training using RFP (ideally using google colab as mentioned in the paper). What are the steps to follow?

Best regards,
Thomas