How to add english as a supported language? about multilingual_text_to_speech

[Tomiinek]

Hi, thank you, nice to hear 🙂

At first, I will ask you a silly question: why do you need a multilingual model? Isn't an multispeaker English text-to-speech model enough for you? Btw I think I have a monolingual monospeaker English model trained using this code on my local machine. If you want, I can share it.

Your plan is ok, but:

a) It was, it actually does just spectrogram inversion, so it might somehow work anyway. You can also use a different model with publicly available pretrained weights (such as WaveGlow).

b-c) You do not need to use Common Voice, English is data rich and has a wide variety of multispeaker datasets. You can for example use LJ Speech and a subset of VCTK to replace CSS10 and CommonVoice. But you should make sure that these English examples are normalized similarly to the rest of the data used for training (i.e, the same punctuation usage, distriution of sentence lenghts and audio durations, ...)

The current code is not very fine-tuning-friendly, unfortunately 😢

[vantony1]

hey!

Thank you for getting back to me so quickly and for the feedback. I really appreciate it. I will try to go ahead and train the model on normalized data from the suggested datasets.

A part of the research team is working on using multi-speaker English text-to-speech model so I just wanted to explore a different path. That being said, if you could share the monolingual mono-speaker English model trained using this code on your local machine -- I'll go ahead and test it out to see if its produces the kind of results we want it to. And of course, if we end up using either model for the research, we will make sure to give you the appropriate credit in the paper.

Best,

Vic

[Tomiinek]

Oh, I see. The english checkpoint is available here. It produces linear spectrograms (not mel), so you should use the Griffin-Lim algorithm for conversion to audio.

Hope it helps 🙂

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.