Comments (7)
That's awesome, thanks for sharing @bghira! How fast was inference on your local machine?
from parler-tts.
it gets slower as the sample size increases but this test script takes about 10 seconds to run on an M3 Max.
from parler-tts.
I got this working as well! Inference time seems to increase more than linearly with prompt size
- 3 seconds of audio: 10 seconds of generation
- 8s of audio: ~90 seconds of generation
- 10 of audio: ~3min of generation
I think the reason is that itself takes a surprising amount of memory — loading the model takes the expected ~3GB of memory, but then inference takes 15 GB on top of that, which is probably what's slowing it down on my machine (16GB M2).
from parler-tts.
I got this working as well! Inference time seems to increase more than linearly with prompt size
- 3 seconds of audio: 10 seconds of generation
- 8s of audio: ~90 seconds of generation
- 10 of audio: ~3min of generation
I think the reason is that itself takes a surprising amount of memory — loading the model takes the expected ~3GB of memory, but then inference takes 15 GB on top of that, which is probably what's slowing it down on my machine (16GB M2).
Swapping activated? I will try on Mac Mini M2 (24GB). Do we know the performance on CUDA on similar machine?
from parler-tts.
on the 128gb M3 Max i can get pretty far into the output window before the time increases to 3 minutes.
it'll take about a minute for 30 seconds of audio.
from parler-tts.
of
I am getting, 2s of audio: 11 seconds and 6s of audio: 36 seconds
from parler-tts.
my data , on 64G M2 Max
seconds of audio | cpu(seconds of generation) | mps(seconds of generation) |
---|---|---|
1 | 7 | 10 |
3 | 13 | 17 |
7 | 30 | 44 |
9 | 41 | 194 |
18 | 71 | 308 |
from parler-tts.
Related Issues (20)
- Does it support Chinese? HOT 2
- Is there a way to create consistent voices? HOT 10
- Streaming support? HOT 3
- Poor quality when batch inferencing HOT 1
- Need the abillity to save/re-use a generated voice HOT 5
- Does it support French? HOT 2
- Add to HF Pipeline
- Running gets output like this...failure
- Benchmarks of parler-tts, the emergence of TTS! HOT 6
- error regarding some tokenizer issue HOT 2
- sampling rate issue HOT 1
- Model stumbling on its words HOT 6
- Training on a NEW language HOT 3
- pls use .mp3 in soundfile output
- How work with data-set. Or question about exemple for work with data-set HOT 4
- How could I make this work in spanish HOT 1
- Unable to get it to run on the gpu. HOT 3
- Tts parler for tfs HOT 2
- Zero-Shot Voice Cloning HOT 4
- Looking for a way to combine spoken words with timestamps in output dictionary
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from parler-tts.