Comments (2)
Yes, I would like to have a documentation. And I'd like to know how to generate clean speech, speech with background noise, purely sound effects and how to save the generate audio to a wav file.
from bark.
Documentation on this chunk:
def generate_audio(text, voice_name):
# generation with more control
from bark.generation import codec_decode, generate_coarse, generate_fine, generate_text_semantic
x_semantic = generate_text_semantic(
text_prompt,
history_prompt=voice_name,
temp=0.7,
top_k=50,
top_p=0.95,
)
x_coarse_gen = generate_coarse(
x_semantic,
history_prompt=voice_name,
temp=0.7,
top_k=50,
top_p=0.95,
)
x_fine_gen = generate_fine(
x_coarse_gen,
history_prompt=voice_name,
temp=0.5,
)
audio_array = codec_decode(x_fine_gen)
As well as more detail on how to actually do the voice cloning. The clone_voice.ipynb has some code, but it also has comments like this:
# the audio you want to clone (will get truncated so 5-10 seconds is probably fine, existing samples that I checked are around 7 seconds)
Which would indicate that the person who wrote it doesn't really understand what they're doing, after all, why are they basing it on samples they saw? And where is it getting truncated? And how is 7 seconds anywhere close to enough training data for a new voice model?
from bark.
Related Issues (20)
- Inference speed HOT 1
- Does it support streaming process?
- max num tokens supported on inference is ~ 40 max. not 256 as it would appear by reading code. HOT 2
- Bulgarian as supported language
- Timestamp audio generated
- Trying to run with half precision gives error "RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'" HOT 1
- Add support and instructions for direct IPA texts.
- Fine tuned prompting.
- Chirp link
- attention mask and the pad token id were not set warning HOT 1
- Get deterministic output (same seed)
- GPU AMD
- Batch processing for long form generation
- ModuleNotFoundError while trying to load entry-point bdist_wheel: No module named '_ctypes'
- ImportError: cannot import name 'AutoProcessor' from partially initialized module 'transformers' (most likely due to a circular import) HOT 1
- Links of live examples of bark or chirp do not work in readme.md
- How to make it work directly from C# without Python?
- Bark Voice clone doesnt work fresh after installed HOT 1
- Bark
- persian
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bark.