why do we need multiple languages & multiple speakers? about multilingual_text_to_speech

[tuetschek]

Hi @thivux , I can't speak for @Tomiinek and only remember this vaguely, but I believe the problem / reason you want to have more languages AND more speakers is that you need to model to dissociate the languages & speakers from each other, to be able to generalize and code-switch. If there's only 1 speaker per language, the speaker embeddings are too closely tied to the language and the model won't be very good at switching to the other language – you'll see how your training goes. I believe you shouldn't need more languages, but having more speakers in each of the two languages, even with less or lower-quality data, should help.

[Tomiinek]

@tuetschek is completely right, thank you!!!