Comments (1)
-
The npy files in */test_wavs are generated by the MFA tool, but first its corresponding phoneme sequence has to be known.
-
It is not limited to the above method, but any tool that can predict the duration of articulation can be used, such as the acoustic model of ASR.
-
The above method can accurately estimate the duration information of the reference audio. For cloning, in fact, the accuracy of duration information is not so demanding, and the result of coarse estimation using manual methods can achieve the same effect. For example, using a speech spectrogram viewing tool, or other audio annotation tools, the duration of phonemes can be estimated audiovisually.
-
The Style_Encoder in this model is equivalent to an audio frame encoder, where the final output of the network is related to the content only, with phoneme position information embedded in the results. Based on these temporal position encodings, a simple estimation of the phoneme duration of the reference audio can be performed using the Style_Encoder. Better yet, the Style_Encoder method does not require knowledge of the phoneme sequence corresponding to the audio.
One-Shot-Voice-Cloning/TensorFlowTTS/tensorflow_tts/models/moduls/core.py
Lines 700 to 705 in 6beec14
from one-shot-voice-cloning.
Related Issues (17)
- what is this HOT 1
- Other language support HOT 1
- python3.9无法兼容llvmlite HOT 1
- Is english text is supported? HOT 2
- preprocess code
- hi, could the training script be released?
- 是否可以实现音色克隆?
- tensorflow-addons requirements issue
- Import error
- Waiting for the training scripts! HOT 2
- import error : from tensorflow_tts.audio_process import preprocess_wav HOT 11
- import error HOT 2
- How to generate the duration statistical info, like test_wavs/*.npy file. HOT 1
- Tts_handel = UnetTTS(models_and_params, text2id_mapper, feats_yaml) 报错 HOT 2
- AttributeError: 'dict' object has no attribute '__NUMPY_SETUP__'报错 HOT 4
- 有更详细的训练和使用教程吗,萌新看不懂
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from one-shot-voice-cloning.