Comments (3)
Please refer to Espnet for the trainig process.
from ppg-vc.
Please refer to Espnet for the trainig process.
Hi, Dr.liu,
Your job is so gorgeous, use the Encoder part of ASR task instead of traditional Kaldi way, this inspires us much!
We explored ESPNet, but still have some questions wanna get ur help:
Q1: You provided the “/conformer_ppg_model/*” files, and if we wanna make these runnable as the "espnet/egs/librispeech/asr1/" example in ESPNet, how should we make preparation steps? For instance, 1、the data preparation, 2、the files organization, and 3、how to prepare the corresponding "run.sh" script?
Q2: As ur description in paper, the bottle neck features of Encoder output in ASR task ,are extracted as "speaker independent information". Do this kind of features can be equal to traditional "ppg" features? Further more, can we researchers work in Voice Conversion field, take this way to extract "ppg" features, instead of traditional Kaldi way?
Best wishes!
Luke
from ppg-vc.
Thank you for the questions.
For Q1:
I adapted espnet a lot; it seems that espnet asr models always downsample the encoder input along the temporal axis more than 4x and do not support phoneme as output symbols. Source codes should be modified correspondingly for VC applications. But the basic steps for the training process is very similar to those presented in espnet asr recipes, including the data preparation, files organization. The run.sh should be modified a little bit, e.g., the language model can be skipped. Sufficient familiarity of espnet source code should be necessary if you want to train a content encoder using your own data.
For Q2:
Please refer to this paper for your questions: TTS Skins: Speaker Conversion via ASR
.
Good VC performance validate the speaker independence property of the bottle neck feature obtained in this way. The paper listed above says that BNF is better than PPG features, but this could really be a model selection thing.
Hope this can help.
Songxiang Liu
from ppg-vc.
Related Issues (20)
- Does this project support cross lingual voice conversion? HOT 5
- Vocoder model HOT 1
- Training strategy
- Why the model produced noise on silence audio file?
- question about the training of encoder-decoder HOT 8
- why std.sqrt() is performed twice in utterance_mvn?
- 刘博您好,看到这里说Source codes should be modified correspondingly for VC applications
- Influence of 10ms to 40ms rate on VC in Conformer
- about MFCC feature extraction
- Can you create a google colab file for running the test ? HOT 1
- missing files HOT 3
- Is there any requirement on the audio quality of training data?
- training code for conformer + ctc missed files HOT 1
- Why is sampling rate not consistent for different feature extraction?
- differences between any-to-many and any-to-any?
- ZeroDivisionError: float division by zero HOT 1
- finetuning vocoder
- Hi, I wanna ask how to fintune the pretrained speaker encoder with mandarin dataset?
- Colab For Running Test
- Help with "any to many voice conversion with location relative seq2seq modeling" paper
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ppg-vc.